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(54) A three-dimensional representation method and an apparatus thereof 



(57) A thrae-cfimenetonal representation meted for 
generating a three-dimensional image by displaying 
two-dimensional images on a plurality of image planes 
(101, 102) located at different depth positions wherein 
•two-dimensional images (105, 106) are generated in 
which an object to be presented is projected, along the 



line of sight of an observer, onto the plurality of image 
pEanes located at different. depth positions as seen from 
the observer/ the brightness levels of the generated two- 
dimensional images are changed individually lor each 
image plane and the generated two-dimensional imag- 
es are displayed on the plurality of image planes. 
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Description 

[0001] The present invention relates toathree-dimen^ 
sionai representation method and an apparatus capable 
of electronically reproducing a moving picture or video 
with a reduced amount of information on a three-dimen- 
sional image. 

[0002] A liquid crystal shutter eyeglasses system 
shown in Fig. 1 is well known as a conventional system 
which is electrically rewritable, has a small amount of 
information and can display a three-dimensional video. 
[0003] The working principle of the liquid crystal shut- 
ter eyeglasses system will be explained below, 
[0004] I n this liquid crystal shutter eyeglasses system, 
a three-dimensional object tx1 is shot by cameras (a2, 
rjtS) from different directions to generate Images {paral- 
lactic images) representing the three-dimensional ob- 
ject a1 as viewed from different directions. 
[0005] The images taken by the cameras {o2, ct3) are 
combined by a video signal converter cc4 into a single 
Video signal and fed into a two-dimensional display (for 
example, CRT display) o5, 

[0006] An observer $7 views an image on the two- 
dimensional display cc5 by wearing liquid crystal shutter 
eyeglasses .oca 

[0007] Here, when the two-dimensional display ccS fs 
displaying an image from the camera cc3, the liquid crys- 
tal shutter eyeglasses aB are made opaque on the left 
side and transparent on the right side. When the two- 
dimensional display ct5 is displaying an image from the 
camera o2, the liquid crystal shutter eyeglasses aG are 
made transparent on the left side and opaque on the 
right side, 

[0008] By switching the above operations at high 
speed, the viewerfeels he is watching parallactic imag- 
es with both eyes because of the after image effect and 
therefore can see the object three-dimansionaljy be- 
cause of binocular parallax, 
[0009] Further, a volumetric system as shown in Figs. 
2A and 2B has been proposed as one of the conven- 
tional systems that are electrically rewritable, have a 
small amount of information and can display a three^di- 
mermional video. 

[0010] The working principle of this volumetric system 
is explained in. the following. 
[0011] In the volumetric type, as shown in Fig, 2B t a 
three-dimensional object pi Is.sampled in the direction 
of depth as seen from the viewer to generate a set of 
two-dimensional images p2, which is reproduced in a 
depth direction on a time division basis on a volumetric 
three-dimensional display p3 to display a reproduced 
three-dimensional image p4. 
[0012] The liquid crystal shutter eyeglasses system 
shown in Fig. 1 , however, has a drawback that because 
of the required use of the liquid .crystal shutter eyeglass- 
es 016, the system, when used for tefeconferencing, 
looks very unnatural. 

[0013] Further, there are large inconsistencies among 



binocular parallax, convergence and focusing, which 
are physiological factors of stereoscopy. 
[0014] That is, in the liquid crystal shutter eyeglasses 
system shown In Fig, 1, although the requirements of 
s binocular parallax and convergence are almost met, this 
system will cause eyestrain because the focal plane is 
on the display surface. 

[0015] in the volumetric type shown in Figs. 2A and 
2B, the depth positions of the reproduced three-dimen- 
10 sionai object pi are close to the surfaces on which im- 
ages are actually displayed, and are also disposed be- 
tween these surfaces, so that unlike the liquid crystal 
shutter eyeglasses system, this volumetric system can 
suppress contradictions among binocular parallax, con- 
vergenee and focusing. 

[001 6] With the vol umetric system, however, because 
the depth positions of the reproduced images are dis- 
crete, it is difficult to reproduce a three-dimensional ob- 
ject located at an intermed iate position between the dis- 
ss creet display positions, or a three^limensional object 
that varies greatly in the depth direction. 
[0017] It is an object of the present Invention to pro- 
vide a three-dimensional representation method and 
apparatus capable of displaying a video without requir- 
es ing a viewer to wear glasses. 

[0018] Another object of the invention is to provide a 
three-dimensional representation method and appara- 
tus which can suppress contradictions among physio- 
logical factors for stereoscopy. 
30 [0019] Another object of the invention is to provide a 
three-dimensional representation method and appara- 
tus which can be electrically erased and programmed. 
[0020] These and other objects and novei features of 
the invention will become apparent from the following 
35 descriptions in this specification and accompanying 
drawings, 

[0021] Representative aspects of the present inven- 
tion may be briefly summarized as follows. 
[0022] This invention is characterized by a thfee-di- 

40 mensional representation method for generating a 
three-dimensional image by displaying two-dimensional 
images on a plurality of image planes located at different 
depth positions, the method comprising the steps of: 
generating two-dimensional images by projecting an ob- 

45 ject to be presented, along the line of sight of an observ- 
er, onto a plurality of image planes located at different 
depth positions as seen from the observer; and chang- 
ing brightness levels of the generated two-dimensional 
images individually for each image plane and displaying 

Si? the generated two-dimensional images on the plurality 
of image planes. 

[0023] According to the invention , when the object to 
be presented is displayed at a depth position close to 
the observer, the brightness levels of the two-dimen- 
55 sionai images displayed on those image planes of the 
plurality of image planes which are close to the observer 
may be raised and the brightness levels of the two-di- 
mensional images displayed on the image planes re- 
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mote from the observer may be lowered. When the ob- 
ject to be presented is displayed at a depth position re- 
mote from the observe^ the brightness levels of the two- 
dimensional images displayed on those image planes 
of the plurality of image planes which are close to the 
observer may be lowered and the brightness levels of 
the two-dimensional images displayed on the image 
planes remote f rom the observer may be raised. 
[C024] The two-dimensional images are displayed on 
the plurality of image planes in such a way that the two- 
dimensional images overlap each other when the two- 
dimensional images are viewed from one point on a line 
which passes through the right and left eyes of an ob- 
server, and that an overall brightness level as seen by 
the observer is equal to the brightness level of the orig- 
inal object to be presented, 
[0025] According to the invention, the two-dimension- 
al images are arranged to overlap by viewing from one 
point on the line which passes through the right and left 
of the observer and the two-dimensional images are en- 
larged or reduced in the horizontal direction respective- 
ly 

[0026] According to the Invention., the two-dimension- 
al images may be switched successively to generate a 
three-dimensional moving image. 
{0027] According to the invention, when the two-di- 
mensional images include a plurality of images of an ob- 
ject moving in a direction of depth and the object is mov- 
ing toward the observer, the brightness levels of the ob- 
ject images displayed on the plurality of image planes 
may be progressively raised toward an image plane 
close to the observer and progressively lowered toward 
an image plane remote from the observer in synchro- 
nism with the successive switching of the two-dimen- 
sional images, and when the two-dimensional images 
include a plurality of images of an object moving in a 
direction of depth and the object is moving away from 
the observer, the brightness levels of the object images 
displayed on the plurality of image planes may be pro- 
gressively lowered toward an image plane close to the 
observer and progressively raised toward an image 
plane remote from the observer in synchronism with the 
successive switching of the two-dimensional Images. 
[0Q2S] According to the invention, a three-dimension- 
al display may comprise: a first means for generating 
two-dimensional images by projecting an object to be 
presented, along the line of sight of an observer, onto a 
plurality of image planes located at different depth po- 
sitions as seen from the observer; a second means for 
displaying the two-dimensional images generated by 
the first means on the plurality of image planes located 
at different depth positions as seen from the observer; 
and a third means for changing brightness levels of the 
two-dimensional images displayed on the plurality of im- 
age planes individually for each image plane. 
[0029] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
and partial reflecting.rnirrors combined with the plurality 



of two-dimensional displays except for one two-dimen- 
sional dispiay located at the remotest depth position 
from the observer, the partial reflecting mirrors being 
adapted to locate images of the two-dimensional dis^ 

5 pJays on the line of sight of the observer. 

[0030] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
and combinations of partial reflecting mirrors and lens- 
es, trie partial reflecting mirror and lens combinations 

io being combined with the plurality of two-dimensional 
displays except for on e two-dimensional display located 
at the remotest depth position from the observer, the 
partial reflecting mirror and lens : combinations being 
adapted to locate images of the two-dimensional die- 
ts plays on the line of sight of the observer. 

[0031 1 According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mirror com- 
bined with one of the plurality of two-dimensional dis^- 

20 plays which is located at the remotest depth position 
from the observer, the total reflecting mirror or partial 
reflecting minor being adapted to locate an image of the 
one two-dimensional dispiay on the tine of sight of the 
observer; and partial reflecting mirrors combined with 

ss the two-dimensional displays except for the one two-di- 
mensional display located at the remotest depth posit ion 
from the observer, the partial reflecting mirrors being 
adapted to locate images of the two-dimensional dis- 
plays on tie line of sight of the observers. 

30 [0032] According to the invention, the second means 
may comprise: a plurality of two-dimensional displays; 
a combination of a total reflecting mirror and a lens or a 
combination of a partial reflecting mirror and a lens, the 
combination being combined with one of the plurality of 

ss two-dimensional displays which is located at the remot- 
est depth position from the observer, the combination 
being adapted to locate an image of the one two-dimen- 
sional display on the line of sight of the observer; and 
combinations of partial reflecting mirrors and lenses, the 

40 combinations bein g combined with the two-dimensional 
displays except for one two-dimensional dispiay located 
at the remotest depth position from the observer, the 
combinations being adapted to locate images of the two- 
dimensional displays on the line of sight of the observer. 

4s [0033] According to tie invention, the second means 
may comprise: a plurality of scatter plates capable of 
controlling a switching between a transmitting state and 
a scattering state or a plurality of reflection plates capa- 
ble of controlling the switching between a reflecting state 

so and a transmitting state, the scatter plates or reflection 
plates being located at different depth positions as 
viewed from the observer; a plurality of projection type 
two-dimensional displays for projecting two-dimension^- 
al images onto the plurality of scatter plates or the plu- 

ss rality of reflection plates; and a plurality of shutters dis- 
posed between theplurality of scatter plates or reflection 
plates and the plurality of projection type two-dimen- 
sional displays, the plurality of shutters being adapted 



3 



5 



EPO950 377 A2 



6 



to switch between a transmitting state and a cutoff state 
in synchronism with the switching between the transmit- 
ting stale and the scattering state of the plurality of scat- 
ter plates or between the reflecting state and the trans- 
mitting state of the plurality of reflection plates, 
[0034] According to the invention, a lens optical sys- 
tem may be disposed between the observer and tine plu- 
rality of imageplanes located at different depth positions 
as seen from the observer. 

[0035] According to the invention, the second means 
may comprise a two-dimensional display, an optical sys- 
tem, and a varifocal mirror. 

[0036] According to the invention, the second means 
may comprise: a vibration screen which vibrates in the 
direction of depth; an optical system induding a lens; a 
scanning means for raster-scanning a laser beam; and 
a laser beam source, 

[0037] According to the invention, the second means 
may comprise: an LED display having an LED array; a 
parallel advancing/rotating device for parallelly advanc- 
ing/rotating the LED display; and a video feeding device 
for feeding a video signal to the LED display. 
[0038] According to the invention, the second means 
may comprise: a film having a two-dimensional image 
recorded therein or two-dimensional display; an image 
transforming optical system having a prism or mirror; 
and a projection drum. 

[0039] According to the invention, the second means 
may successively switch the two-dimensional images 
generated by the first means to generate a moving 
three-dimensional Image. 

[0040] According to the invention, when the two-di- 
mensional images generated by the first means include 
a plurality of images of an object moving In a direction 
of depth and the object is moving toward the observer, 
the third means may progressively raise the brightness 
levels of the object images displayed on the plurality of 
image planes toward an image plane close to the ob- 
server and progressively lower the brightness levels of 
the object images toward an Image plane remote from 
the observer In synchronism with the successive switch- 
ing of the two-dimensional images by the second 
means, and when the object is moving away from the 
observer, the third mBans may progressively lower the 
brightness levels of the object images displayed on the 
plurality of image planes toward an image plane close 
to the observer and progressively raise the brightness 
levels of the object images toward an Image plane re- 
mote from the observer in synchronism with the succes- 
sive switching of the two-dimensional images by the 
second means. 

[0041] the above and other objects, effects, features 
and advantages of the present invention will become 
more apparent from the following description of embod- 
iments thereof taken in conjunction with the accompa- 
nying drawings. 

Fig. Usaschematicconfigurationofaconventional 



three-dimensional display; 
Figs. :2A and 2B are schematic configurat ions of an- 
other conventional three-dimensional display; 
Fig. 3 is a schematic diagram showing the principle 
s of a three-dimensional display according to a first 
embodiment of the present invention; 
Fig. 4 is a schematic diagram showing the principle 
of a th ree-dimensional display according to the first 
embodiment; 

Fig. 5 is a schematic diagram showing the principle 
of a th ree-dimensional display according to the first 
embodiment; 

Fig. 6 is a schematic diagram showing the principle 
of a th ree-dimensional display according to the first 
embodiment; 

Fig. 7 is a schematic diagram showing the principle 
of a th ree-dimensional display according to the first 
embodiment; 

Fig. 8 is a schematic diagram showing the principle 
2Q of a th ree-dimensional display according to the first 
embodiment; 

Figs. 9A and 9B are schematic diagrams showing 
the principle of a three-dimensional display accord- 
ing to the first embodiment; 

25 Figs.10Aand10Bareschematicdiagramsshowing 
the principle of a three-dimensional display accord^ 
ing to the first embodiment; 
Fig. 11 is a schematic diagram showing the principle 
of a three-dimensional display according to a sec- 

& ond embodiment; 

Fig. 12 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 

Fig. 13 Is a schematic diagram showing the prinei- 
35 pie of a three-dimensional display according to the 
second embodiment; 

Fig. 14 is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
second embodiment; 
40 Fig. 15 is a schematic diagram showing the prince 
pie of a three-dimensional display according to the 
second embodiment; 

Fig. 16 -is a schematic diagram showing the princi- 
ple of a three-dimensional display according to the 
45 second embodiment; / 

Figs. 1 7A and 1 78 are schematic diagrams showing 
the outline configuration of a three-dimensional dis^ 
play according to a third embodiment of the inven- 
tion; 

$0 Rg&. 18A and 13B are schematic diagrams showing 
examples that allow flexible changes in the position 
of an image plane by incorporating a lens or the like 
in an optical system of the third embodiment; 
Figs. 19 is a schematic diagram showing an exam- 

55 pie in which there is an increased number of two- 
dimensional displays* according to the third embod- 
iment; 

Fig. 20 is a schematic diagram showing an example 
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which uses a plurality of projector type two-dimen- 
sional displays of the th ird embodiment and scatter 
plates to form an optical system that projects irnag* 
esfrom the projectors onto the scatter plates; 
Fig, 21 is aschematic diagram showing another ex- s 
ample which adds optical devices to the third em- 
bodiment; 

Fig, 22 is a schematic diagram showing the outline 
configuration of a varifocal mirror type volumetric 
three-dimensional display according to a fourth em- iQ 
bodiment of the invention; 
Fig, 23 is a schematic diagram showing the outline 
configuration of a vibration screen type volumetric 
three-dimensional display according to the fourth 
embodiment; « 
Fig, 24 is a schematic diagram showing the outline 
configuration of a rotary LED type three-dimension- 
al display according to a fifth embodiment of the in- 
vention; 

Fig, 25 is a schematic diagram showing the outline 20 
configuration of a synthalyzer type three-dimen- 
sional display according to a sixth embodiment of 
the invention; 

Figs. 26A and 26B are conceptual diagrams show- 
ing the outline configurations of the three-dimen- 2$ 
sional display according to a seventh embodiment 
of the invention; 

Fig, 27 is a conceptual diagram showing how a dis- 
tribution device works according to this embodi- 
ment; SO 
Figs. 28A to 29C are conceptual diagrams showing 
how images are moved according to this embodi- 
ment; 

Figs. 29Aand 29B are schematic diagrams showing 
a method of moving images according to this em- 35 
bodiment; 

Figs. 30Aand 30B are schematic diagrams showing 
a method of moving the displays according to this 
embodiment; 

Fig, 31 is a schematic diagram showing a method 40 
of moving the whole apparatus according to this 
embodiment; 

Figs. 32A to 320 are schematic diagrams showing 
a position detection method according to this em- 
bodiment; 4$ 
Figs. 33Aand33Bareschematic diagrams showing 
another position detection method according to this 
embodiment; 

Fig. 34 is a block diagram showing the concept of 
a three-dimensional display according to an eighth so 
embodiment of the invention; 
Figs. 35A to 35D are schematic diagrams showing 
the principle of the three-dimensional display ac- 
cording to the eighth embodiment; 
Fig. 36 is a schematic diagram showing the outline 55 
configuration of the three-dimensional display ac- 
cording to the eighth embodiment; 
Fig. 37 is a schematic diagram showing the outline 



configuration of a three-dimensional display ac- 
cording to a ninth embodiment of the invention; 
Fig. 38 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a tenth embodiment of the invention; 
Fig. 39 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to an eleventh embodiment of the invention; 
Fig. 40 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a twelfth embodiment of the Invention; 
Fig. 41 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a thirteenth embodiment of the invention; 
Fig. 42 is a schematic diagram showing the outline 
configuration of a three-dlmensjonal display ac- 
cording to a fourteenth embodiment of the inven- 
tion; 

Fig. 43 is a schematic diagram showing the method 
of generating two-dimensional images in the three- 
dimensional display according to the fourteenth em- 
bodiment; 

Fig. 44 is a schematic diagram showing the corre- 
spondence between pixels of a two-dimensional 
display and polarization varying elements of a po- 
larization varying device in the three-dimensional 
display according to the fourteenth embodiment; 
Fig, 45 is a schematic diagram showing the corre- 
spondence between pixels of a two-dimensional 
display and polarization varying elements of a po- 
larization varying device in the three-dimensional 
display according to the fourteenth embodiment; 
Fig. 46 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 47 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 48 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three-dimensional display according to the four- 
teenth embodiment; 

Fig. 49 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
three«dimensi6nal display according to the four- 
teenth embodiment; 

Fig. 50 is a schematic diagram showing the outline 
configuration of a three-dimensional display ac- 
cording to a fifteenth embodiment of the invention; 
Figs, 51 A and 51 Bare schematic diagrams showing 
a method of displaying a three-dimensional image 
in the th ree-dimensional display according to the fif- 
teenth embodiment; 

Fig. 52 is a schematic diagram showing one exam- 
ple of a polarizing type bifocal optical system that 
can be used in the three-dimensional display ac- 
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cording to each of the embodiments of the inven- 
tion; 

Fig. 53 is a schematic diagram showing the relation 
between incom ing light and exit light in the polariz- 
ing type bifocal optical system shown in Fig. 52; $ 
Fig, 54 is a schematic diagram showing another ex- 
ample of a polarizing type bifocal optical system that 
can be used In the three-dimensional display ac- 
cording to each of the embodiments of the inven- 
tion; io 
Fig. 55 is a schematic diagram showing still another 
example of a polarizing type bifocal optical system 
that can be used in the three-dimensional display 
according to each of the embodiments of the inven- 
tion; 15 
Fig. 56 is a schematic diagram showing an optical 
system that can be used instead of the polarizing 
beam splitter shown in Fig. 55; 
Fig. 57 is a cross-sectional viewshowing the outline 
configuration of a twisted .nematic type polarization ?o 
varying device that can be used in the three-dimen- 
sional display according to each of the embodi- 
ments of the invention; 

Fig. 58 is a schematic diagram showing the operat- 
ing principle of the twisted nematic type polarization & 
varying device shown in Fig. 57; 
Fig, 59 is a cross-sectional view showing the outline 
configuration of an in-plane type polarization vary- 
ing device that can be used in the three-dimensional 
display according to each of the embodiments of the so 
invention; 

Fig. 60 is a schematic diagram showing the working 
principle of the in-plane type polarization varying 
device shown in Fig. 59; 

Fig. 61 is a schematic diagram showing the outline 35 
configuration ol a homogeneous type polarization 
varying device that can be used in the three-dimen- 
sional display according to each of the embodi- 
ments of the invention; 

Figs. 62A to 62C are schematic diagrams showing 40 
light incident on the homogeneous type polarization 
varying device shown in Fig. 61 and an orientation 
of an alignment layer; 

Figs. 6SA and63B are schematic diagrams showing 
the operating principle of the homogenous type po- & 
iarization varying device shown in Fig. 51 ; 
Fig. 64 is a schematic diagram showing the prince 
pie of a head-mounted display according to a nine- 
teenth embodiment of the invention; 
Fig. 65 is a schematic diagram showing a method so 
of generating two-dimensional. images in the head- 
mounted display according to the nineteenth em- 
bodiment; 

Fig. 66 is a schematic diagram showing a method 
of displaying a three-dimensional ; image in the 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 67 is a schematic diagram showing a method 



of displaying a three-dimensional image in the 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 68 is a schematic diagram showing a. method 
of displaying a three-dimensional image in the 
head-mounted display according to the n ineteenth 
embodiment; 

Fig. 69 is a schematic diagram showing a method 
of displaying a three-dimensional image in the 
head-mounted display according to the nineteenth 
embodiment; 

Fig. 70 is a schematic diagram showing the princi- 
ple of a head-mounted display according to a twen- 
tieth embodiment of the invention; 
Fig, 71 js a schematic diagram showing a method 
of generating two-dimensional images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 72 is a schematic diagram showing a method 
of displaying three-dimensional Images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 73 is a schematic diagram showing a method 
of displaying three-dimensional images in the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 74 is a schematic diagram showing a method 
of displaying three-dimensional images in the head- 
mounted display accordin g to the twentieth embod- 
iment; 

Fig. 75 Is a schematic diagram showing a method 
of displaying three-dimensional images in .the head- 
mounted display according to the twentieth embod- 
iment; 

Fig. 76 is a schematic diagram showing one exam- 
ple .of an optical system that can be used in each of 
the embodiments of the invention; 
Fig. 77 is a schematic diagram showing another ex- 
ample of an optical system that can be used in each 
of the embodiments of the invention; 
Fig. 78 is a schematic diagram showing a further 
example of an optical system that can be used in 
each of the embodiments of the invention; 
Fig. 7g is a schematic diagram showing a further 
example of an optical system that can be used in 
each of the embodiments of the invention; 
Fig. 80 is a schematic diagram showing a further 
example of an optical system that can be used in 
each of the embodiments of the invention; 
Figs. 81 Aand 81 Bare schematic diagrams showing 
three-dimensional displays according to a twenty- 
second embodiment of the invention; 
Figs. 82Aand 82B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
third embodiment of the invention; 
Figs. 83A and 83B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
fourth embodiment of the Invention; 



S 



11 



EP 0959 377 A2 



12 



Figs. B4A to 84E are schematic diagrams showing 
three-dimensional displays according to a twenty- 
fifth embodiment of ins invention; 
;Figs,,85Aand 85B are schematic diagrams showing 
three-dimensional displays according to a twenty- 
sixth embodiment of the invention; 
Figs. 66A to 86D are schematic diagrams showing 
three-dimensionai displays according to a twenty- 
seventh embodiment of the invention; 
Figs. 87A and 87B are schematic diagrams showing 
three-dimensionai displays according to a twenty- 
eighth embodiment of the inventor; 
Figs. :88A to 88C are schematic diagrams showing 
the principle of the invention; 
Fig, 89 is a schematic diagram showing the princi- 
ple of the invention; 

Figs. 90A and 9GB are schematic diagrams showing 
the principle of the invention; and 
Figs. 91 A and 531 B are schematic diagrams showing 
a three-dimensional representation method accord- 
ing to a further embodiment of the invention. 

[0042] The present patent application claims the pri- 
ority from Japanese Patent Application Nos. 
1 39602/1 998, 262B04/1 998, 280739/ 1 998, 
304374/1998, 326931/1998 and 60, 393/1 999 filed with 
the Japanese Patent Office. The Japanese Patent Ap- 
plication No. 326931/1 998 has followed the necessary 
procedure in claiming the priority in Japan from the Jap- 
anese Patent Application No. 139602/1998. 
[0043] Therefore, embodiments described In this 
specification use, at paragraphs that contain the same 
descriptions of the above patent applications, the eorre« 
spending paragraph numbers used in these applica- 
tions. The paragraph numbers used in this specification 
are assigned with symbols as shown In a table below to 
distinguish between the applications, it should also be 
noted that descriptions under the assigned paragraph 
numbers use different drawing numbers and reference 
numbers from those of the above patent applications in 
order to make them distinguishable, 



Table 1 



Symbol • 


Application number 


A 


326931/1998 (Including 1 39602/1998} 


B 


262SW1998 


C 


280739/1998 


D 


304374/1998 


E 


60393/1999 


F 


New matters 



[0044] Now, by referring to the accompanying draw- 
ings, embodiments of the present invention will be de- 
scribed in detail. 



{0045] Throughout the drawings, parts having the 
same functions are assigned like reference numbers 
and their explanations are not repeated. 
[0046] in the description pf the embodiments, a word 

S "plane" on which toputan image isused. "This is similar 
in meaning to an imageplanethat is often used in optics. 
Means to realize such an image plane can obviously be 
realized by combining many optical devices, which in- 
clude a variety of optical elements, such as lens, total 

io reflecting mirror, partial reflecting mirror, curved mirror, 
prism, polarizer and wavelength plate, and two-dimen- 
sional displays, such as CRT (cathode ray tube), liquid 
crystal display, LED (light emitting diode) display, plas- 
ma display, FED (field emission display), DMD (digital 

15 mirror display), projection type display and line drawing 
type display. 

[0047] Although this specification deals mainly with a 
case where a three-dimensional object is represented 
as two-dimensional images displayed on two planes, it 
20 is obvious that the similar effect can be expected when 
two or more planes are used 

[/W3Q12] 

2B [Embodiment 1] 

[004B] Fig. 3 and Figs. 1QA and 10B are schematic 
views for explaining the principle of a three -dimensional 
display according to a first embodiment of the present 

so invention. 

[0049] As shown in Fig. 3, a plurality of planes, such 
as planes 101, 102 (plane 101 is closer to the observer 
1 00 than plane 1 02) are provided in front of an observer 
1 00. To display a plurality of two-dimensbnal images on 

SB these planes an optical system 103 is constructed by 
using two-dimensional displays and a variety of optical 
elements (details will be given later). 
[0050] Examples of the two-dimensional displays 
may include CRT, liquid crystal display LED display, 

40 plasma.display, FED display, projection type display and 
[ine drawing type display, and examples of the optica] 
elements may include lens, total reflecting mirror, partial 
reflecting mirror, curved mirror, prism, polarizer and 
wavelength piate. 

45 [0051] Then, as shown in Fig. 4, a three-dimensional 
object 1 04, which is to be presented tothe observer 100, 
is projected onto the planes 101, 102 to generate imago- 
es 105, 106 (hereinafter referred to as two-dimensional 
images}. 

50 [0052] The two-dimensional images can be formed by 
a variety of ways, which include a technique that uses 
two-dimensional images formed by photographing the 
object 104 by camera along the line of sight; a technique 
that synthesizes a plurality of two-dimensional images 

55 shot from different directions; or synthesizing and mod- 
eling techniques based on computer graphics. 
[0053] As shown in Fig, 3 f these two-dimensional im- 
ages 1 05, 1 06 are displayed on the planes 1 01 , 1 02 re- 
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spectively so that they overlap each other by viewing 
from one point on the line of which passes through the 
right and left eyes of the observer 1 00. 
[0054] This can be achievedby pfacingihe centers or 
gravity centers of the two^Jimensional images 105, 1 05 
and by controlling a ratio of enlargement/reduction of 
each image. 

IA-0013J 

10055] An important point of this embodiment is that, 
In the apparatus with the above configuration, trie bright- 
ness of each of the images 1 05, 1 0S is changed accord- 
ing to the depth position of the three-dimensional object 

104 while keeping constant the overall brightness as 
seen by the observer 100. 

[G05$l One example method of changing the bright- 
ness is explained as follows. 
[0057J Here, since the drawings are monochrome, in 
following drawings, a part having high value in bright- 
ness is shown with high density except for Fig. 10A and 
108 

[0053] When for example the three-dimensional ob- 
ject 104 is on the plane 101, the brightness of the two- 
dimensional image 105 on th is plane is set equal to the 
brightness of the three-dimensional object 104 and the 
brightness of the two-dimensional image 108 is set to 
zero, as shown in Fig. 5. 

[0059] Next, when for example the three-dimensional 
object 104 is slightly moved away from the observer 100 
and is located at a position slightly away from tie plane 
101 and closer to the plane 102, the brightness of the 
two-dimensional image 105 is slightly lowered and the 
brightness of the two-dimensional image 106 is slightly 
raised, as shown in Fig. 6. 

[0060] When for example the object 1 04 is moved fur- 
ther away from the observer 1 00 and is located at a po- 
• sftion further away from the plane 1 01 and closer to the 
plane 102, the brightness of the two-dimensional image 

1 05 is further lowered and the brightness of the two-di- 
mensional image 106 is further raised, as shown in Fig, 
7. 

[0061] When the object 104 is on the plane 102, the 
brightness of the two-dimensional image 106 is set 
equal to the brightness of the object 1 04 and the bright- 
ness of the two-dimensional image 105 is set to zero, 
as shown in Fig. 8. 

[0062] By displaying in this manner, the observer 100 
is made to feel as if the object 104 is located between 
the planes 101 and 102 because of observer's physio- 
logical or mental factors or optical illusion although what 
is actually shown lo the observer is the two-dimensional 
images 105, 106. 

[0063] That is, when lor example the two-dimensional 
images 107, 108 with almost equal brightness are dis- 
played on the planes 101 and 102,the object 104 looks 
as if it lies near to a middle point between the depth po- 
sitions of the planes 101, 102. 



[A-0014] 

[0064] Although the above description mainly con^ 
cerns a method and apparatus which represents the 

s depth posiiionof the entirethree-dimensional object 1 04 
by using two-dimensional images displayed on the 
planes 101, 102, for example, the first embodiment can 
apparently be used as a method and apparatus for 
showing the depth of a tae-ditrrensional object itself. 

io [0065] One such example is described below, 

[0066] First, the outline configuration of a three-di- 
mensional display according to this embodiment is as 
shown in Fig. 3, in which a : plurality of planes, for exam- 
ple planes 101, 102 (plane 101 is closer to an observer 

rs 100 .than plane 102), areset in front of the observer 1 00 
and in which an optical system 103 is constructed by 
using, for example, two-dimensional displays and a va- 
riety of optical elements to display a plurality of two-di- 
mensional Images on these planes {details will be given 

so in third and subsequent embodiments). 

[0067] Next, the three-dimensional object 104 to be 
presented to the observer 1 00 is shot in the direction of 
the line of sight of both eyes of the observer 100 to gen- 
erate, for instance, two-dimensional images 105, 106. 

25 [0069] These two-dimensional images 105, 106 are, 
as shown in Fig. 3, displayed on the planes 101 and 102 
respectively such that they overlap each other by view- 
ing from the point on the line of which passes through 
the right and left eyes of the observer. 

so [0069] this can be realized by placing the centers or 
gravity centers of the two-dimensional images 105, 106 
and by controlling a ratio of enlargement/reduction of 
each image, as described earlier, 
[0070] Position setting of each Image and enlarge- 

ss ment/reduction are executed by a computer connected 
with the two-dimensional display apparatus, 
[0071] An important point of this embodiment is that, 
In the apparatus with the ak>ove configuration, the bright- 
ness of each part of each of the images 105, 106 is 

40 changed according to the depth position of each part of 
the object 1 04 while keeping constant the overall bright- 
ness as seen by the observer 100. 
[0072] One example method of changing the bright- 
ness will be explained by referring to Figs. 9A and 9B 

4£ for a case where two display planes are used. [A^001 5] 
[0073] Fig. 9A represents an example image dis- 
played on a plane close to the observer TOO, for exam- 
ple, on the plane 101 , and Fig. 9B represents an exam- 
ple image displayed on a plane remote from the observ- 
es er 100, for example, on the plane 102, 

[0074] Referring to Figs. 9 A and 9B that show a cake 
as an object, upper and lower surfaces of the cake (ob- 
ject) are almost flat, except for the candles stuck on the 
top, the wall surface Is cylindrical, and the candles are 

& arranged near tie circumference of the upper surface 
of the cake. 

[0075] In the two-dimensional images 105, 106 in this 
case, on the upper and lower surfaces the upper parts 
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represent the remote parts of the cake. On the wall sur- 
face, the centra! part of the wall surface corresponds to 
the near side of the cake, and as you go from the center 
toward the left and right, the surface position moves to- 
ward the far side. And the central part of the hidden wall 
surface, which is shown higher than the front wall sur- 
face, is located on the far side, 
[0076] in this case, the brightness on the upper and 
lower surfaces is progressively changed according to 
the depth .position so that, as shown In Fig, 9A, on a 
plane close to the observer 100, or the plane 101, a por- 
tion close to the observer 1 00 (a lower part of the two- 
dimensional image) has a higher brightness level and a 
portion remote from the observer (an upper part of the 
two-dimensionai Image) has a tower brightness level. 
[0077] J=u rthsr r on a plane remote from the observer, 
or the plane 102, the brightness is progressively 
changed according to the depth position so that, as 
shown in Fig. 98, a portion close to the observer (a Eower 
part of the two-dimensional image) has a lower bright- 
ness level and a portion remote from the observer (an 
upper part of the two-dimensional image) has a higher 
.brightness level. 

[0078] Next, the brightness o! the cylindrical portion 
is also changed progressively according to its depth po- 
sition so that, on a plane close to the observer 1 00, or 
the plane 101, a portion close to the observer 100 
(around the center) has a higher brightness level and a 
portion remote from the observer (the near left and right 
end) has a lower brightness level, as shown in Fig. 9A. 
[0079] On a plane remote from the observer 100 f or 
the plane 102, the brightness is changed progressively 
so that, as shown in Fig, 98, a portion close to the ob- 
server 100 (around the center) has a lower brightness 
level and a portion remote from the observer (the near 
left and right end) has a higher brightness level. 
[0080] By displaying in this manner, the observer 1 00 
is made tof eel as if there is a cylindrical cake with almost 
flat top and bottom surfaces because of observer's 
physiological or mental factors or optical illusion al- 
though what is actually shown to the observer is two- 
dimensional images, 

[0081 ] Although this embodiment has taken as an ex- 
ample a cylindrical object with almostflattop and bottom 
surfaces, it is apparent that the similar effect can be ob- 
tained if the object has other shapes. 

[A-0016] 

[0082] in the embodiment 1 , we have explained a 
case where the brightness of the two-dimensional im- 
ages displayed on two or more planes are changed 
while keeping the overall brightness as seen by the ob- 
server 100 constant 

[0083] However, progressively towering the overall 
brightness as seen by the observer 100 toward the rear 
to emphasize the solidity of the object is acpmmon used 
technique in computer graphics. It is obvious that the 



use ol this technique also in this invention can promote 
fie effect of the invention. One such example -is shown 
in Figs. 1 0A and 1 0B. 

[0084] In Fig, 1 0A, the brightness of the floor is gradr 

5 ually lowered toward the upper part of the Figure to 
make one feel as if the ftoor shown at the upper part of 
the Figure lies remote f rom the viewer in the depth di- 
rection. 

{0085] tn Fig. 10B, the brightness of a chain (circular 
w objects), in addition to the floor is also lowered progres- 
sively toward the left to produce an effect that makes 
one perceive that the chain on the left side is far in the 
depth direction, 

[0086] As the means for calculating the degree of 
ffi such brightness reduction, there are many methods 
available, including a method that uses a formula & - 
B x T0/T (T; distance from a viewing point, TO: distance 
from a viewing point to a reference plane) in calculating 
the brightness B 1 that produces the above effect with re- 
50 spect to the object's brightness B, 

[A-0017] 

[0087] It is apparent that the two-dimensional image 

6 plane in the embodiment 1 does not have to be a flat 
plane and can take other forms such as spherical, ellip- 
soidal or quadratic surfaces, or other complex curved 
surfaces and produce the similar effect. 

[0038] In the embodiment 1 , because, unlike the con- 
So ventional method shown in Fig. 1 , there are at least two 
image display pianos on the near and far sides of the 
optical illusion position, contradictions among the bin- 
ocular parallax, convergence and focusing -- the prob- 
lem experienced with the conventional method - can be 
as suppressed greatly, which in turn is expected to reduce 
eyestrains. 

[0089] Since the focus position is fixed at a position 
Where the viewer looks at two or more planes at the 
same time, the problem of the conventional method is 

40 improved greatly, 

[0090] in this case, it is necessary to determine the 
depth distances of a plurality of the planes, the depth 
distances being within the range wherein blurring of the 
images obtained when the focus point is adjusted at the 

45 position of the object to be displayed on the depth direc- 
tion by viewing from the observer is less is less than one 
obtained when the focus points are adjusted at the plu- 
rality of the planes. 

[0091] Further, unlike the conventional method shown 
so jn Fig. 2, an object that exists at an intermediate position 
between the image planes, too, looks three-dimensional 
to the viewer and therefore the system ol this embodi- 
ment offers the advantage of realistic solidity, not the 
kind of solidity presented by gathering sheet-divided 
SB depths, 

[0092] Further, because the embodiment 1 can also 
show an object present between a plurality of planes, it 
offers the advantage of being able to reduce the amount 
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of data greatly when performing a three-dimensional 
display. 

[0093] Further, because the embodiment 1 takes ad- 
vantage of human physiological or mental factors or op^ 
tical illusion based only on brightness changes of imag- 
es, the embodiment does not require the use of a co- 
herent light source such as a laser and facilitates the 
color stereoscopic image representation, 
[0004] Further, since this -invention does not include 
mechanical driving parts, it can suitably reduce the 
weight of and improve the reliability of the apparatus. 
[0095] The embodiment 1 mainly concerns a case 
where there are only two planes for displaying two-cfi- 
mensional Images and where an object to be presented 
to the observer lies between the two planes. It is, how- 
ever, apparent that the sim liar configuration can be em- 
ployed ff there are more planes or the object to be pre- 
sented Is located at a different position. 
[0096] Further, in this embodiment, it is also apparent 
that a three-dimensional video image can be displayed 
by successively changing two-dimensional images, 

[N] 

[0097] When the described two-dimensional images 
are displayed to overlap by viewing from one point on 
the line which passes through the right and left eyes of 
the observer, in the case that especially, the one point 
between the right and left eyes of the observer is used 
as the point on the line which passes through the right 
and left eyes of the observer, reliability for obtaining an 
effect of three-dimensional consciousness is become 
bigger. 

[0098] If it says simply, the above effect is obtained In 
many people or in many cases. 
[0099] F u rtner, the center point between the right and 
left eyes of the observer is used as the above one point, 
It is easy to obtain the above effect and has a merit that 
a size of double images in the right and left eyes gener- 
ated by planes 01 and 02 becomes smaller. 
[0100] It is useful for change a depth or an inclination 
of the object to be recognized by enlarging or reducing 
the size of a horizontal direction. 
[0101] However, variety of the brightness in the two- 
dimensional images having same colors is described, 
when a color of the object to be displayed is purple, the 
object is made by using (mixing) a red display of one 
plane and a blue display of another plane, the brightness 
of the two planes being deferent. 
[0102] This is useful for matching a back ground im- 
age with the object in view of color matching when the 
color of the outline of the object is different f romthe color 
of the object itself though each displays provides 
strange feeling. 

[0103] For the purpose to obtain the above effect, it is 
important to have a common area of depth of the dis- 
tance between planes displaying the above two-dimen- 
sional images, the common area being within the range 



in case that the object is viewed by single eye at -the 
position of the right eye or the left eye. 
[0104] If there is not common area the obssrber feels 
the object far from the planes. 

s 

[A-0018] 
[Embodiment 2] 

to [0105] Figs. 11 to 16 illustrate the principle of a three- 
dimensional display according to a second embodiment 
of the present invention, 

[0106] in the three-dimensional display of the second 
embodiment, as shown in Fig. 11, a plurality of planes, 

is such as planes 111 and 112 (plane 111 is closer to an 
observer 110 than plane 112), are installed in front of 
the observer 110and, to displayaplurality of two-dimen- 
sional images on these planes, an optical system 113 is 
constructed by using two-dimensional displays and var- 

20 joys optica! elements. 

[0107] Among the possible two-dimensional displays 
there are CRT, liquid crystal display, LED display, plas- 
ma display, FED display, projection type display and line 
drawing type display. Examples of the optical eiements 

25 may include lens, total reflecting mirror, partial reflecting 
mirror, curved mirror, prism, polarizer and wavelength 
plate. 

[0108] Then> as shown in Fig. 12, a three-dimensional 
object 114, which is to be presented to the observer 1 1 0, 

$o js projected onto the planes 111,112 to generate Images 
115, 116 (two-dimensional images). 
[0109] The two-dimensional images 115, 116 can be 
formed by a variety of ways, which include a technique 
that uses two-dimensional images formed by photo* 

35 graphing the object 114 by camera along the line of 
sight; a technique that synthesizes a plurality of two-di- 
mensional images shot from different directions; or syn- 
thesizing and modeling techniques based on computer 
graphics. 

40 

IA-D019] 

[0110] As shown in Fig. 11, the two-dimensional im- 
ages 115, 11.6 are displayed on the planes 111 and 112 

4S respectively so that they overlap each other on the line 
of sight of the observer (thiscan be achieved by locating 
the centers or gravity centers of the two-dimensional im- 
ages 115, 1 1 6 on the line of sight). 
[0111] An important point of this embodiment is that 

so the brightness of each image 1 1 5, 11 6 is changed ac- 
cording to a change over time of the depth position of 
the three-dimensional object 114 while keeping con- 
stant the overall brightness as seen by the observer 11 0. 
[0112] This is explained by taking an example case 

55 where.thethree-dimensional object 114 moves from the 
plane 111 to the plane 112 with elapse of time. 
[0113] As shown in Fig. 13, when the three-dimen- 
sional object 114 is on the plane 111, the brightness of 
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the two-dimensional image 115 on the plane 111 is set 
equal tolhat of the three-dimensional object 11 4an.d the 
brightness of the two-dimensional image 116 on the 
plane 11 2 is set to zero. 

[0114] Next, as shown in Fig. 14, when.the three-dh 
mensional object 114 progressivety moves slightly away 
from the observer 110 and inches from the plane 111 
toward the plane 112 over lime, the brightness of the 
two-dimensional image 115 is lowered slightly over time 
according to the movement in the depth position of the 
th ree-dimensional object 114 and at the same time the 
brightness of the two-dimensional image 116 is slightly 
raised over time. 

[011S] Next, as shown in Fig. 1 S, when the three-di- 
mensional object 1 1 4 moves further away from the ob- 
server 110 and inches from the plane 111 further toward 
the pfane 112 over time, the brightness of the two-di- 
mensional image 115 is lowered further over time ac- 
cording to the movement in the depth position of the 
three-dimensional object 1 14 and at the same time the 
brightness of the two-dimensional image 116 is raised 
f urther over time, 

[0116] When, as shown In Fig. 16, the three-dimen- 
sional object 1 1 4 final ly reaches the plane 1 1 2 overtime, 
the brightness of the two-dimensional image 11 6 on the 
plane 112 is changed over time until it becomes equal 
tothe brightness of the three-dimensional object mac- 
cording to the movement in the depth position of the 
three-dimensional object 114 and at the same lime the 
brightness of the two-dimensional image 115 on the 
plane 1 11 is changed over time until it becomes zero. 

IA-00211 

[0117] By displaying in this manner, the observer 110 
is made to fee! as if the three-dimensional object 114 
moves over time from the plane 111 tothe plane 112 in 
the direction of depth because of observer's physiolog- 
ical or mental factors or optical illusion although what is 
actually shown to the observer is two-dimensional im- 
ages 115, 116. 

[0116] While this embodiment describes a case 
where the three-dimensional object 114 moves over 
time from the ptene 111 to the plane 112, ft is obvious 
that the similar display effect can also be produced in 
cases where the object moves from an intermediate 
depth position between the planes 111 and 112 to the 
plane 112, where it moves from the plane 111 to an in- 
termediate depth position between the planes 111 and 
112, and where it moves from an intermediate position 
between the pianes 111 and 112 to another intermediate 
position between the planes 111 and 112. 
[01 Id] Although this embodiment has described a 
case where there are only two planes on which to place 
two-dimensional images and the three-dimensional ob- 
ject 114 to be presented to the observer 110 moves be- 
tween the two planes, it is obvious that the similar con- 
figuration can be employed and the similar effect ex- 



pected even when the number of two-dimensional im- 
age display planes is more than two or when the three- 
dimensional object being presented moves crossing a 
plurality of planes. 

s [0120] Although this embodiment has described a 
case where one three-dimensional object 114 moves 
between two planes on which two-dimensional images 
are displayed, it is obvious that when a plurality of three- 
dimensional objects move, i.e., when the displayed two- 

■w dimensional images each include a plurality of object im- 
ages moving in different directions, the brightness of the 
object images displayed on the respective display 
plan es needs only to be changed according to the mov- 
ing directions of the objects and the speeds of their 

15 movements, 

[A-0G22] 
[Embodiment 3] 

20 

[0121] Figs. 17 A and 17B illustrate the outline config- 
uration of a three-dimensional display according \a a 
third embodiment of the invention, 
[0122] In the three-dimensional display of the third 

£5 embodiment, as shown in Fig. 17A, a plurality of two- 
dimensional displays 2a01 , 2a02, a total reflecting mir- 
ror 2a03 {e.g., reflect ivityAransmittivity = 100/0) and a 
partial reflecting mirror 2a04 (e.g., 
reflectlvity/transmittivity = 50/50) are used to construct 

so an optical system on which to place a plurality ol two- 
dimensional images described in the previous first and 
second embodiments, 

[0123] By changing the arrangements of these con- 
stitutional components, it Is possible to place an image 

as plane 2a05 and an image plane 2a06 at different posi- 
tions in the direction of depth, the image ptane 2a05 be- 
ing formed by reflecting the displayed image of the two- 
dimensional display 2a01 by the total reflecting mirror 
2a03 and passing it through the partial reflecting mirror 

40 2a04, the image plane 2a06 being formed by reflecting 
the displayed image of the two-dimensional display 
2a02 by the partial reflecting mirror 2aGA 
[0124] This optical system uses only mirrors and thus 
has the advantage of less degradation of picture quality, 

4£ [0125] The two-dimensional displays 2a0l , 2a02 may 
use CRT, liquid crystal display, LED display, plasma dis- 
play, FED display, DMD display, projection type display 
and line drawing type display. 
[0126] It is obvious that the similar effect of this inven- 

$0 lion can be produced even when the total reflecting mir- 
ror 2a03 of this embodiment is replaced with a partial 
reflecting mirror, although this lowers the brightness of 
image of the two-dimensionai display 2a0l , 
[0127] While this embodiment has described a case 

55 where the order of depth positions of image pianes are 
equal to the order of depth positions of the two-dimen- 
sional displays, it is apparent that the order of depth po- 
sitions of the image pianes can be changed freely by 
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changing the distances from the total reflecting mirror 
or partial reflecting minor to the respective two-dimen- 
sional displays. 

JA-0023] 

[012$] As shown In Fig. 17B 1 an optical system for ar- 
ranging a plurality of two-dimensional images described 
in the previous embodiments 1 and 2 can be constructed 
by directly arranging the two-dimensional display 2a01 
without using the total reflecting mirror 2a03 and by us- 
ing the partial reflecting mirror 2a04 (e.g., reflectivity/ 
transmittivity^ 50/60). 

[01 29] That is, the image plane 2a05, which is formed 
by passing the displayed image of the two-dimensional 
display 2a01 through the partial reflecting mirror 2a04, 
and the image plane 2a06, which Is formed by reflecting 
the displayed image of the two-dimensional display 
2a02 by the partial reflecting mirror 2a04, can be located 
at different positions in the direction of depth. 

[A-0024] 

[01 30] Wh ile this embodiment has described a case 
where the order of depth positions of the image planes 
is equal to the order of the depth positions of the two- 
dimensional displays, It is obvious that the order of the 
depth positions of the image planes can be changed 
f reely by changing the distances from the partial reflect- 
ing mirror to the respective two-dimensional displays, 
[0131] One example which can change the position 
of the image plane more flexibly by incorporating lens 
or the like in the optical system is shown in Figs. 18A 
and 18B. 

[01 32] As shown in Fig. 1 8A, by adding convex lenses 
2507, 2bOSto the optical system* which comprises a plu- 
rality of two-dimensional displays 2b01 , 2b02, a total re- 
flecting mirror 2b03 (e.g., ref lectivity/transm Stivity = 
100/0) and a partial reflecting mirror 2b04 (e.g., reflec- 
tivity/transmittivity - 50/50), in order to change the in> 
age position, it is seen that the positional relation be- 
tween the image plane 2b05 and the image plane 2bQ6, 
which has been restricted by the size of the displays, 
can be more flexibly set. 

[0133] It is obvious thatthe similar effect of this Inven- 
tion can be obtained even if the total reflecting mirror 
2b03 of this embodiment is replaced with a partial re- 
flecting mirror, although this lowers the brightness of an 
image of the two-dimensional display 2b01 . 
[01 34] While in this embodiment we have described 
a case where the order of depth positions of image 
planes is equal to the order of depth positions of two- 
dimensional displays, it isobviousihatlheorderof depth 
positions of Image planes can be changed freely by 
changing the distances from the total reflecting mirror 
or partial reflecting mirror to the two-dimensional dis- 
plays or by installing lens or the like in the optical sys- 
tem. 



[A-0025] 

[01 35] Further, as shown in Fig, SB, by adding convex 
lenses 2b07, 2b08 to the optical.system, which includes 

s the two-dimensional display 2b01 directly installed with- 
out using the total reflecting mirror 2b03 and also a par- 
tial reflecting mirror 2b04 (e.g., reflectivity/transmittivity 
- 50/50), to change the image position, it is seen that 
the positional relation between the image plane 2b05 

ro and the image plane 2b06, which has been restricted by 
the size of the displays, can be more flexibly set. 
[01 361 As in the ordinary lens system, it may of course 
be advantageous In terms of distortion to use a combi- 
nation lens in addition to convex lenses. 
[0137] Further, although this embodiment has shown 
a case where virtual images are used which are formed 
by installing the two-dimensional displays at positions 
within a lens focal length, it is obvious that the invention 
can also be applied to a case where real images are 

20 used which are formed by installing the two-dimensional 
displays at positions outside the lens focal length. 
[0138] While this embodiment has described a case 
where the order of depth positions of image planes is 
equal to the order of depth positions of the twb-dimen- 

25 sional displays, it is obvious that the order of depth po- 
sitions of image planes can be changed freety by change 
ing the distances from the partial reflecting mirror to the 
two-dimensional displays or installing lens or the like in 
the optical system, 

30 

[A-0026] 

[0139] Fig, 19 shows an example that uses an in- 
creased number of two-dimensional displays. 

3S [0140] In this case, a plurality of two-dimensional dis- 
plays 2c01 , 2c02, 2c0& 2cQ4, 2cQa, a total reflecting 
mirror 2c06 (e.g., reflectivily/iransmiUivity = 100/0) and 
partial reflecting mirrors 2c07 (e.g., reflectiviiy/lransmit- 
tjvity - 50/50) 3 2c08 (e,g,, reflectivity/transmittivity - 

40 33.3/667), 2c09 (e.g. , reflsctivity/transmMivity .= 25/75), 
2c1 0 (e.g., reflectivity/transmittivity ■= 20/80) are used to 
construct an optical system toarrange a plurality of two- 
dimensional images. 

[0141] By changing the arrangements of tfiese eon- 
45 stitutional components, it Ss possible to place an image 
plane 2c11 and image planes 2c 12-2c 15 at different po- 
sitions in the direction of depth, the image plane 2c11 
being formed by reflecting the displayed image of the 
two-dimensional display 2c01 by the total reflecting mir^ 
so ror 2c06 and passing it through the partial reflecting mir- 
rors 2c07-2c10 } the image planes 2c12-2c15 being 
formed by reflecting the displayed images of the two- 
dimensional displays 2c02-2c05 by the partial reflecting 
mirrors 2c07-2c10 and passing them through the partial 
5$ reflecting mirrors. 

[0142] This optical system uses only mirrors and thus 
has the advantage of less degradation of picture quality. 
[0143] While this embodiment has described a case 
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where therms are five two-dimensional displays, it is ap- 
parent that the similar configuration can be adopted 
when a different number of twp-dirnensio.nal displays 
are used. 

[01 44] In this case also, it is obvious that adding fens 
systems as shown In FEgs. 17 and 18 makes it easy to 
control the positions of image planes. 
[01 45] it is also obvious .that replacing the total reflect- 
ing mirror 2c03 in this embodiment with apartial reflect- 
ing mifror will produce the similar effect to that of the 
invention, although this lowers the brightness of the im- 
age of the two-dimensional display 2c01. 
[0146] While this embodiment has described a case 
where the order of depth positions of image planes are 
equal to the order of depth positions of the two-dimen- 
sional displays, it is apparent that the order of depth po- 
sitions of the image planes can be changed freely by 
changing the distances from the total reflecting mirror 
or partial reflecting mirror to the respective two-dimen- 
sional displays. 

[A-0027] 

[0147] Fig. 20 shows one example of an optica! sys- 
tem for arranging a plurality of two-dimensional images 
which is constructed by using a plurality of projection 
type two-dimensional displays (for example, CRT type, 
LCD type, iLV type and DMD type) 2d0l, 2d02, 2d03, 
2d04, 2d05and scatter plates 2d06, 2dG7, 2dOS, 2dG9, 
2d1 0 and by projecting images from the projectors onto 
the scatter plates. 

[01 4S] Here, the scatter plates 2dQ6-2d1Q may be 
such devices as can control scattering/transmission or 
reflection/transmission, such as polymer dispersed Irq-^ 
uid crystal devices, holographs polymer dispersed liq- 
uid crystal devices or combined devices of liquid crystal 
and multi-lens array. Shutters 2dll-2d1S may be such 
devices as can control transmission/interruption, such 
as twisted nematic liquid crystal devices, ferroelectric 
liquid crystal devices or mechanical shutter devices, 
[0149] The scatter plates 2d06-2d10 are arranged at 
different depth positions, the focusing planes of the pro- 
jector type two-dimensional displays 2dQ1-2d05 are 
al igned with these scatter plates 2d06-2d10 J images are 
projected onto the scatter plates, and the scattering/ 
transmission timing of the scatter plates 2d06-2d10 is 
synchronized with the transmission/interruption timing 
of the shutters 2d11-2d15 when activating the scatter 
plates and the shutters. This enables the depth positions 
of the image planes 2dil-2dl 5 formed on the scatter 
plates 2d06-2d1 0 to be controlled on a time division ba- 
sis. 

[01 SO] in this way, the use of projectors provides an 
advantage of enhanced level of freedom of display lay- 
out. 



[A-0G2B] 

[0151] Although this embodiment has described a 
case where there are five two-dimensional displays, the 

s similar configuration can be employed when a different 
number of displays are provided. 
[0152] It is obvious that the lamps of projectors can 
be turned on or off instead of using the shutters, 
[0153] Further, although the third embodiment mainly 

?o concerns a case where the image planes are located 
near, within or beyond the three-dimensional display, 
these image planes can easily be located away from or 
in front of the three-dimensional display. One such ex- 
ample Is shown in Fig. 21. 

1$ [0154] For example, it can easily be seen that by ar- 
ranging a lens system 3e03 In front of an optical system 
3e0l as shown in Fig. 21, the internal image planes 
3eD2 can be moved to the positions of external image 
planes 3e04. 

2Q [0155] This offers the advantage that because the im- 
ages are reproduced floating in space, the images are 
more likely to look three-dimensional to the observer 
than when the images are located inside or behind the 
display 

25 

[A-0029] 
[Embodiment^ 

30 [0150] The fourth embodiment of the present inven- 
tion is an example in which the opUcaleystem in the pre- 
vious embodiments 1 , 2 lor arranging a plurality of two- 
dimensional images is constructed by using a volumet* 
ric three-dimensional display, 

35 [0157] As described in Three-Dimensional Display 11 
(by Senju Masuda, published by Sangyo Tosho K.K.), 
the volumetric three-dimensional display performs 
three-dimensional image presentation by stacking two- 
dimensional images (same as the two-dimensional im- 

40 ages in the embodiment 1 ) sampled in the direction of 
depth. 

[01 58] The volumetric three-dimensional display in- 
cludes a varifocal minor type and a vibration screen 
type. 

45 [01 59] The varifocal mirror type, as shown in Fig. 22, 
transmits an image displayed on the two-dimensional 
204 such as television through a haJf mirror.201 and a 
varifocal mirror 202 to form a three-dimensional image 
(virtual image) for an observer 100, 

$P [0180] The varifocal mirror 202, a key device in this 
method, is made by applying metal such as aluminum 
or multilayer dielectric on the surface of a woofer (low 
tone reproducing speaker) to form a concave mirror. 
When vibrated like an ordinary woofer, the concave mir^ 

ss ror portion changes its curvature to change the focal 
length. 

[0161] Hence, the position of a virtual image or a real 
image of the two-dimensional display 204 can be 
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changed by changing the focaf length. 
[0162] Therefore, by displaying images sampled in 
the direction of depth (two-dimensional images obtained 
by slicing a th ree-dimensionai object at positions shifted 
in the direction of depth and sampling the sliced por- 
tions) on the two-dimensional display 204 in synchro- 
nism wish the change in the fpcal length of the varifocal 
mirror 202, it is possible to form athree<iimensional im- 
age on a time division basis (by taking advantage of the 
after image effect). 

[01 63] With this method and apparatus, tilts invention 
can provide a pluraEity of two-dimensional images by re- 
peating a short-duration activation of the two-dimen- 
sional display a number of times. 
[0164] The depth position of an image plane can be 
specified by the vibration position of the varitocal mirror 
202. 

[0165] Therefore, changing the brightness of the two- 
dimensional Images described in the preceding embod- 
iments 1 , 2 and displaying the images on the image 
planes can produce the effect of this invention, 
[0163] In addition to few moving parts, this method al- 
so has an advantage of being able to form a plurality of 
Image planes easily, 

[A-0030] 

[0167] The vibration screen type volumetric three^di- 
mensionai display, as shown in Fig. 23, Includes: a vi- 
bration screen (e.g., diffusion plate, lenticular plate and 
fly's eye lens) 301 that vibrates in the direction of depth; 
an optical system 302 including lens; a scanner for 
raster scanning a laser beam in horizontal and vertical 
directions (horizontal/vertical scanner comprising, for 
example, a light deflector using a polygon mirror and a 
galvanometer mirror) 303; and a laser light source 304. 
[01 S3] This method drives the scanner 303 at high 
speed when the vibration screen 301 is at a desired 
depth position, writes a sampled image corresponding 
to that depth position on the screen, and repeats this 
process by changing tie depth position within the after 
image time, thereby reproducing a three-dimensional 
image, 

[0169] With this method and apparatus, this embodi- 
ment can present a plurality of two-dimensional Image 
planes by repeating within the after image time a proc- 
ess of writing the sample Image on the vibration screen 
301 at high speed, 

[0170] The depth position of the image plane can be 
specified by the position of the vibration screen 301 , 
[01 71] Hence, by changing the brightness of the two- 
dimensional images described in the precedln g embod- 
iments 1, 2 and displaying the images on these image 
planes, the effect of this invention can be produced. 
[01 72] Th is method has the advantages of being abte 
to easily suppress distortions on the screen surface and 
easily form a plurality of image planes. 



[A-0031] 
[Embodiment 5] 

5 [0173] The fifth embodiment of the present invention 
is a rotary LED type three-dimensional display, which, 
as shown in Fig. 24, includes an LED display 401 having 
an LED array, a rotating device 402 for rotating the LED 
display 401, and a video supply device 403 for feeding 

W a video signal to the LED display 401, 

[01 74] This method requires sampling a th ree-dimen- 
sionai object in polar coordinates with the rotating axis 
of the LED display 401 as a center. 
[017S] The two-dimensional image sampled in the po- 
ts lar coordinates is displayed on the LED display 401 in 
synchronism with the rotation of the LED display 401 
and this process is repeated by changing the rotation 
angle to represent a three-dimensionai image. 
[0176] With this method and apparatus, this embodi- 
20 ment can present a plurality of two-dimensional Image 
planes by converting a desired two-dimensional Image 
plane into the polar coordinates, displaying at high 
speed an Image on LEDs at the converted position co- 
ordinates within the after image time, and repeating this 

6 process while changing the rotation angte. 

[0177] Then, by changing the brightness of the two- 
dimensional images described in the preceding embod- 
iments 1 , 2 and displaying the images on these image 
planes, the effect of this invention can be produced. 
30 [0178] This method offers the advantages of being 
able to easily suppress distortions on the screen sur- 
face, rotate the LED display 401 relatively easily, and 
easily form a plurality of image planes. 

3S [A-0032] 

[Embodiment 6] 

[0179] The sixth embodiment of the present invention 
40 j s a synthalyzer type thre e-dimensionaf display which, 
as shown in Fig. 25, includes a film recorded with two- 
dimensional images or a two-dimensional display (e.g., 
CRT and liquid crystal display) 501, a conversion optical 
system such as prism and mirror 502, and a projection 
45 drum 503. Denoted 504 is a light source and 505 a shut- 
ter. 

[01 80] The projection drum 503, a key device in this 
method, is made of a transparent material {e,g„ glass 
and acry lics or other transparent plast Ice) and has a var- 
50 ying thickness. The image of the film or two-dimensional 
display 501 is projected through the projection drum to 
display an image. 

[0181] This method utilizes thefact that as the projec- 
tion drum 503 is rotated, the drum thickness changes 
55 causing the position of the image plane to change. 
[0182] thus, by displaying images sampled in the di- 
rection of depth (two-dimensional images obtained by 
slicing a three-dimensional object at positions shifted In 
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the direction of depth and sampling the sliced portions) 
on the two-dimensional display 501 in synchronism with 
the change in the position of ths image plane, It is pos- 
sible to form a three-dimensional image on a time divi- 
sion basis (by utilizing the after image effect). 
[0183] With this method and apparatus, this embodi- 
ment can present a plurality of two-dimensional image 
planes by repeating the short-duration displaying of the 
film or two-dimensional display a number of times within 
the after image time, 

[0184] The depth position of the image piane can be 
specified by the thickness of the projection drum, 
[01 35] Therefore, by changing the brightness of the 
two-dimensional images described in the preceding em- 
bodiments 1 , 2 and displaying the images on these im- 
age planes, the effect of this invention can be obtained. 
[0136] In addition to few moving parts, this method 
has the advantage of being able to form a plurality of 
image planes easily 

[01371 The invention realized by the inventor has 
been described in detail in conjunction with embodi- 
ments. It should be noted that the invention is not limited 
to these embodiments and that various modifications 
may be made without departing from the spirit of the in- 
vention, 

[A-0033] 

[0188] The advantages and effects obtained by the 
representative embodiments described above may be 
summarized briefly as follows. 

[A-0034] 

[01 89] Because a plurality of two-dimensional images 
obtained by slicing a three^irnensionai object at posi- 
tions shifted in the direction of depth and sampling the 
sliced portions are displayed on planes 1-N (N^2) hav- 
ing different depth positions from an observer and be- 
cause the brightness of each of the t wo-dimensional im- 
ages on respective planes is changed independently of 
each other, it is possible to suppress contradictions 
among physiological factors of stereoscopy, reduce the 
amount of information, and reproduce an electrically re- 
writable three-dimensional image, 

[B-0019] 

[Embodiment 7] 

[0190] Figs. 26 A and 26B showaconceptual diagram 
showing the outline configuration of a three-dimensional 
display according to this embodiment. For components 
of the three-dimensional display of this embodimentthat 
are identical with the corresponding components of the 
preceding embodiments 1 to 6, detailed explanations of 
their constructions and operations are omitted. 



[B-002G] 

[0191] in the three-dimensional display of this embod- 
iment, as shown in Fig. 26A, a two-dimensional image 

& with depth information which was generated by a two- 
dimensional image generation device 1102 is distribut- 
ed into a plurality of images (in this case, five images) 
for different depth positions by a distributor 1103. The 
brightness for each of the distributed two-dimensional 

*0 images with depth information is changed by a bright- 
ness change device 1104 according to the depth posi- 
tion of the image, The display elements are moved by 
a position change device (two-dimensional image 
change device) 1105 to such positions that the axes of 

is the images as seen from an observer overfap each oth- 
or, and the brightness changed images are displayed 
on the two-dimensional displays 1106-1110, thus pro- 
viding a three-dimensional representation. 

*> [B-0021] 

[01$&] Fig. 27 is a conceptual diagram, showing the 
working of the distributor 11 03. An image 1 207 to be rep- 
resented between an image plane 1202 and an image 
25 plane 1203 Is displayed on the image plane 1202 and 
the image plane 1 203. An image 1 208 to be represented 
between image planes 1203 and 12041s displayed on 
the image planes 1203 and 1204. images to be repre- 
sented between image planes 1204 and 1205 and be- 
so tween image planes 1 205 and 1.20.6 are displayed in the 
similar way. The image to be represented (for example, 
image 1207) may be located at any position between 
the image planes 1202 and 1203„ For the image 1209 
that is to be represented straddling an image plane (for 
3S example, image plane 1204), a part to be shown in front 
of the image plane 1204 is displayed in the same way 
as the front image 1 208 and a part to be shown beh ind 
the image plane 1 204 is displayed in the same way as 
the rear image 1210. 

40 

[B-0022] 

[0193] In Fig. 268, a two-dimensional image with 
depth information which was generated bya two-dlmen- 

4$ sional image generation device 11 22 is distributed into 
a plurality of images (in this case, five images) for dif- 
ferent depth positions by a distributor 1123, The bright- 
ness for each of the distributed two-dimensional images 
with depth information is changed by a brightness 

5Q change device 1124 according to the depth position of 
the image. Displays 1 1 26-1 1 30 are moved by a position 
change device (two-dimensional image change device) 
1125 to such positions that the axes of the images as 
seen from an observer overlap each other, and the 

55 brightness changed images ara displayed on these dis- 
plays 1126-1130 thus providing a three-dimensional 
representation. 
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[B-0023] 

[0194] Figs. 2SA to 28C are conceptual diagrams 
showing how an image moves, according to this embod- 
iment. 

[0195] Fig. 28A shows a conceptual diagram for a 
case where a th ree-dimensional image is reproduced at 
around an intermediate part between two image planes 
i 301 and 1 302. When the observer viewsfrom a view- 
ing position of an observer 1 303, the images displayed 
onthefrontand rearimage planes are located at Images 

1306 and 1309. When the viewing position of the ob- 
server 1303 moves to a viewing position of an observer 
1 304, the image 1 306 is moved to apcsition of an image 

1 307 and the Image 1 309 to a position of an image 1 31 1 
because the reproducing position of the three-dimen- 
sional image 312 must be fixed. When the viewing po- 
sition moves to a viewing position of an observer 1 305, 
the images are moved to positions of Images 1308 . and 
1310 respectively, 

[B-0024) 

[0196] Fig. 28B is a conceptual diagram for a case 
where a three-dimensional image 1313 is reproduced 
between two image planes 1 321 and 1 322 at a position 
close to the image ptam 1322. When the observerviews 
from a viewing position of an observer 1323, the images 
displayed on the front and rear image planes are located 
at images 1 326 and 1 329. 

je-0025] 

[0197] When the viewing point of the observer 1 323 
moves io a viewing position of an observer 1324, the 
image 1326 is moved to a position of an image 1327 
and the image 1 329 is left almost at its position because 
-the reproducin g position of the three-dimensional image 
1 31 3 needs to.be fixed. When the viewing point moves 
to a viewing position of an observer 1325, the image 
1326 is moved to a position of an image 1328. 

1&0Q26] 

[0198] Fig. 28C is a conceptual diagram for a case 
where a three-dimensional image 1314 is reproduced 
between two image planes 1 331 and 1332 at a position 
close to the image plane 1 331 . When the observer views 
from a viewing position of an observer 1 333, the images 
displayed on thefront and rear image planes are located 
at images 1336, 1337. 

[B-0027] 

[0199] When the viewing point of the observer 1 33.3 
moves to a viewing position of an observer 1334, the 
image 1337 is moved to a position of an image 1339 
and the image 1336 is lef t almost at its position because 



the reproducing position of the three-dimensional image 
1 314 needs to be fixed. Similarly, when the viewing point 
moves to a viewing position of an observer 1335, the 
image 1 337 is moved to a position. of an image 1 338. 

5 

[B-0028] 

[0200] By combining the Image moving methods of 
Figs. 25 A to 28C according to the reproducing position 

10 of a three-dimensional image, it is possible to eliminate 
a double image caused by positional discrepancy be- 
tween the front and rear images even when the viewing 
point of an observer changes and to ensure that the po- 
sitions of gravity centers and outlines of the images on 

1? the front and rear image planes snugly overlap so that 
the observer can recognize the display as a represen- 
tation of a single object. 

[B-0029] 

20 

[0201] Rgs. 29A and 29$ are conceptual diagrams 
showing how the display elements are moved. 
[0202] One method of moving an image is, as shown 
in Figs. 29A and 29B, to move an image 1 403 displayed 

25 on a two-dimensional display 401 vertically or horizon- 
tally or to enlarge or reduce an Image 1413 displayed 
on a two<Jimenstonal display 411, or to combine these 
methods and etectricaliy rewrite the display element, tn 
that case, when a Figure needs to be deformed slightly 

30 {as by trapezoidal deformation) as when an observer 
moves greatly the display element on the display is also 
changed at the same time. When the amount of move- 
ment of the image is small, such a change is not neces- 
sary as tongas the displayed object looks natural to the 

35 observer, 

[S-0030] 

[0203] As the observer moves, the displayed image 
w is rewritten into an image as jt .will appear when viewed 
from the observer, thus producing a movement parallax, 
too. For example, when the observer moves to the left, 
the displayed image is f ©written into an image as it will 
appear when viewed from the left viewing point eorre- 
4£ spending to the position of the observer. By rewriting the 
image according to the change in position of the observ- 
er, the required movement;.parallax can be realized For 
the verticai movement of the observer also, the corre- 
sponding movement paraiiax is produced by the similar 
so method. 

[B-0031] 

[02041 Another method of moving the image, as 
58 shown in Figs. 30A, 30B and 31, is to mechanically 
move two-dimensional displays. The mechanical mov- 
ing method includes: moving two-dimensional displays 
1 501 , 1 502, 1 503 (Fig. 30A); in athree-dimensional dis- 
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play having half mirrors, rotating the. half mirrors 1514, 
1515 (Fig 30B); and moving an entire three-dimension- 
al display 160 1 (Fig. 31). 

[B-0032] 

[0205] When jl is necessary to cause a slight defor- 
mation to a Figure (as by trapezoidal deformation), the 
display element on the display is also changed at the 
same time or corrections are made on an optical system 
such as prism, The optical system for corrections may 
include one of a prism, a lens and parallel plates, or a 
combination of these. When the amount of movemem 
of an image is small, such a change need not be per- 
formed as long as the displayed object looks natural to 
the observer. Mechanically moving the displays change 
es physical positions of the displays and thus can ex- 
pand a viewing zone, In the method ol moving the entire 
three-dimensional display, the viewing zone can be ex- 
panded by making the movement follow the position ot 
the observer, 

[B-0033] 

[0206] As a f u rther image moving method, it is possi- 
ble to combine the display element moving method with 
the mechanical moving method, [n this method, tofollow 
a large movement of an observer, the image is moved 
by the mechanical moving method to expand the view- 
ing zone. To follow a small movement of an observer, 
the display element is moved. This combined method 
can simplify the moving apparatus, prevent the observer 
from feeling incongruous, and ensure swift movement 
of images. 

[B-0034] 

[0207] The movement of an observer may preferably 
be detected by determining the position of the observer 
relative to a three-dimensional display 701 by using an 
infrared sensor 1 702 as shown in Fig. 32A, an ultrasonic 
distance sensor or laser distance sensor 1 703 as shown 
in Fig. 32B and an optical sensor as shown in Fig. 32C. 
For detecting the position of a human using the above- 
described kinds of sensors, publicly known technologies 
may be used. Other known technologies may also be 
used, which include a method that detects the position 
of an observer from the image provided by a camera 
1805 as shown In Fig. 33A and a method that uses a 
magnetic sensor 1S07 possessed by an observer or a 
magnetic sensor 1 806 installed in the three-dimensional 
display to detect the position of an observer 

[B-0035] 

[0203] The present invention has been described in 
detail in conjunction with embodiments and it shouid be 
noted, however, that the invention is not limited to these 



embodiments and that various modifications may be 
made without departing from the spirit of the invention, 

[B-0036] 

[0209] The advantages of this embodiment may be 
briefly summarized as folfows, 

(1) When the viewing point of an observer changes 
or when the observer moves, this embodiment can 
eliminate positional discrepancies between the 
front and rear display Images or minimize the dis- 
crepancies to such an extent that the displayed ob- 
ject does not look unnatural, thus making it possible 
to reproduce a three-dimensional image with no or 
little blur, which would otherwise be caused by de- 
viated overlapping of the front and rear images. 

(2) Whsn the viewing point of an observer changes 
or when the observer moves, the two-dimensional 
images displayed on respective displays are 
changed according to the movement of the observ- 
er's viewing point. This can expand the viewing 
zone. 

(3) When the viewing point of an observer changes 
or when the observer moves, the displays or the 
three-dimensional display are moved according to 
the movement of the observer's viewing point/This 
can expand the viewing zone, 

[O00T3J 

[Embodiment 8] 

[0210] Fig.. 34 is a block diagram showing a concept 
of a three-dimensional display according to this inven- 
tion. 

[0211] The three-dimensional representation method 
of this embodiment, too, has a plurality of image planes 
(display surfaces); for example image planes 2102 f 
2103, set in front of an observer 2101 , as shown in Fig, 
34, and a plural By of two-dimensional images are dis- 
played on these image planesby using two-dimensional 
displays and an optical system. 
[021 2J A three-dimensional object to be presented to 
the observer 2101 is projected onto the image planes 
2102, 2103 along the line of sight of both eyes of the 
observer to generate two-dimensional images. 
[Q213] The two-dimensional images can be generat- 
ed by a variety of methods, which include one that uses 
two-dimensional images of the object shot by camera 
from the line of sight, one that synthesizes a plurality of 
two-dimensional Images shot from different directions, 
and one that uses a synthesizing technique or modeling 
technique based on computer graphics. 

[C-0014] 

[0214] With this embodiment, when an object to be 
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presented is a plurality of objects located at different 
depth positions and overlapping each other on the line 
of sight of the observer2101, an image generator 2105 
generates for each of the objects to be presented two- 
dimensional Images that are to be displayed simultane- 
ously on a plurality of image planes, e.g., the image 
planes 2102, 2103. 

[021 5] That is, in this embodiment, for each object to 
bo displayed there are generated two-dimensional im- 
ages which are projected from the object onto the image 
planes 2102, 21.03 from the Jine of sight of both eyes of 
the observer 21 01. 

[C-0015] 

[021 S] inthiscase, two-dimensional images to be dis- 
played at desired depth positions (two-dimensional im- 
ages for each of tine objects to be presented) are gen- 
erated by the image generator 2105 shown in Fig. 34 in 
the order from the near depth position to the far depth 
position with respect to the observer, in the reverse or- 
der or in a random order, 

[0217] Then, the brightness of the generated two-di- 
mensional images to be displayed on the image planes 
21 02, 21 03 is changed by a brightness change device 
2104 to the brightness values corresponding to their 
depth positions, and the two-dimensional images thus 
generated are displayed on the image planes 2102, 

210a 

[C-0016] 

[0218] A synchronizer 2106 synchronizes the depth 
positions for which the image generator 21 05 generates 
the images with the depth positions for which the syn- 
chronizer 2106 changes the brightness of the images. 
That is, the images and their corresponding depth posi- 
tions are synchronized 

[0219] The synchronizer 2106 shown in Fig. 34 is con- 
ceptually Hiustrated, and the brightness can be changed 
either mechanically or by software. Two or more syn- 
chronizers 2105 may be used. 
[0220] Further, the brightness change device 2104 
and the synchronizer 2106 may be constructed as one 
device. 

[C-0017] 

[0221] A method of displaying a three-dimensional 
image on the three-dimensional display according to 
this embodiment will be described by referring to Fig. 35. 
[D222J Step 2000; Two-dimensional images of an ob- 
ject that one wants reproduced at a front position as 
viewed from an observer, such as a three-dimensional 
image 2204, are changed in brightness by the bright- 
ness change device 2104 and the synchronizer 2106 
and then displayed on image planes 2202, 2203 to re- 
produce the three-dimensional image 2204. 



[0223] Step 2001: Next, two-dimensional images of 
an object that one wants reproduced at an intermediate 
position as viewed from an observer, such as a three- 
dimensional image 221 4, are changed in brightness and 

& dispiayed on image planes 2212, 221 3 to reproduce the 
three-dimensional image 22 1 4. 
[0224] Step 2003: Next, two-dimensional images of 
an object that one wants reproduced at a rear position 
as viewed from an observer, such asalhreo-dimension- 

10 al image 2224, are changed in brightnessand displayed 
on image planes 2222, 2223 to reproduce the three-di- 
mensional image 2224. 

[0225] Changing the brightness can be achieved by 
two methods: one is to change the brightness according 
& to the three-dimensional image to be displayed and then 
display the image, and one is to change the brightness 
continuously while displaying the three-dimensional im- 
age. 

[0226] For example, the brightness of the front image 
20 plane may be changed from high to middle to low and 
the brightness of the rear [map plane from lowtomiddle 
to high so that the overall brightness as seen by the ob- 
server remains constant in order to change the position 
at which the three-dimensional image is reproduced 
& from the front toward the rear it is possible to reverse 
the brightness changing order. Another method is to 
change the brightness freely according to any desired 
position where a three-dimensional image is to be re- 
produced. 

30 

[C-0018] 

[0227] this embodiment greatly differs from conven- 
tional techniques In that the steps 2000, 2001 and 2002 
& in Fig, 35 are repeated at high speed during the dispiay 
of image. 

[022S] Repeating the steps 2000, 2001 and 2002 of 
Fig. 35 at high speed allows the observer 2231 to sec 
the three-dimensional images 2234, 2235, 2236 repro- 
40 ducedat respective positions as shown inthe state 2003 
and also to see the rear image through the front image. 
Here, 2232 and 2233 denote image planes and 2234, 
2236 and 2236 represent three-dimensional images re- 
produced. 

45 |0g29] The speed at which the steps 2QQ0, 2001 and 
20Q2 of Fig. 5 are repeated Is set within the after image 
time of human eye, for example at 60 Hz or higher, to 
realize displaying of a three-dimensional Image without 
flicker. 

so [0230] That is, displaying two or more overlapping 
three-dimensional images can be achieved by perform- 
ing the image displaying procedures on a time division 
basis at high speed such that the resultant images are 
all displayed sequentially within the after image time of 

& human eye. 

[0231] The number of brightness-changed two-di- 
mensionai images for different depth positions needs to 
be greater than tho maximum number of brightness- 
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changed images required to display the overlapping 
portions of the three-dimensional images. 

[C-0019] 

[0232] Fig. 36 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
cording to an eighth embodiment of the invention. 
[0233] in the three-dimensional display of this embod- 
iment, two-dimensional displays 2304, 2305 define the 
front and rear image planes respectively and the two- 
dimensional images displayed on the two image planes 
are arranged on the same optical axis by half mirrors 
2302, 2303. 

[0234] The images displayed on the two-dimensional 
displays 2304, 2305 are, as shown in Fig. 35, rapidly 
changed in brightness and displayed to the observer 
2301 repetitively. 

[0235] The two-dimensional displays 2304, 2305 may 
use CRT, liquid crystal display and plasma display and, 
when higher speed is required, can use displays using 
ferroelectric liquid crystals or antiferroelectric liquid 
crystals. 

[0236] Alternatively, it is possible to use a display that 
allows high-speed random access to individual pixels, 
such as a display of oscilloscope. 
[0237] In this case, the brightness levels of two-di- 
mensional images displayed on the two-dimensional 
displays 2304, 2305 are changed by the two-dimension- 
al displays 2304, 2305 themselves. 

JC-0021] 

[Embodiment 9] 

[0233] Fig. 37 is a schematic diagram showing the 
outline configuration o! a three-dimensional display ac- 
cording to a ninth embodiment of the present invention. 
Reference number 2401 represents an observer, 2402 
and 2403 half mirrors, and 2404 and 2405 twodimen- 
sional displays, 

[0239] The three-dimensional display of this embodi- 
ment differs from the three-dimensional display of the 
eighth embodiment in that the brightness of displayed 
images are changed by beam attenuating filters 2406, 
2407, 

[0240] The beam attenuating filters 2406, 2407 ac- 
cording to this embodiment may be a filter that continu- 
ously changes its tight intensity attenuation by mechan- 
ical rotation, a filter that electrically attenuates light in- 
tensity by liquid crystals, a device that has slits having 
changing opening areas and arranged in the direction 
of rotation and Which mechanically rotates the slits to 
change the brightness, and a device which changes the 
opening time by a ferroelectric shutter to change the 
brightness, 

[0241 ] In the three-dimensional display of this embod- 
iment the attenuation of the beam attenuating filters 



2405, 2407 is synchronized with the two-dimensional 
images displayed on the two-dimensional displays 
2404, 2405 to display a three-dimensional image. 

s [C-0022] 

[Embodiment 10] 

[0242] Fig. 38 is a schematic diagram showing the 
to outline configuration of a three-dimensional display ac- 
cording to a tenth embodiment of the invention. Refer- 
ence number 2501 represents an observer, 2502 and 
2503 half mirrors, 2504 and 2505 screens, 2506-2511 
two-dimensional displays, and 2512-2517 shutters. 
75 £0243] In the three-dimensional display of this embod- 
iment a plurality of projector type two-dimensional dis- 
plays 2506-2511 are used. 

[0244] For example, a two-dimensional display 2506 
displays a two-dimensional image for a front three-di- 

20 mensional image as viewed from an observer, a two- 
dimensional display 2507 displays a two-dimensional 
imageforan Intermediate three-dimensional image, and 
a two-dimensional display 2508 displays a two-dimen- 
sional image for a rear three-dimensional image. Shut- 

25 ters 2512-2514 are operated to project these two-di- 
mensional images sequentially on a time division basis 
onto a screen 2504. 

[0245] Similarly, a two-dimensional display 2509 dis- 
plays a two-dimensional image tor a front threedimen- 

30 sionai image as viewed from an observer, a two-dimen- 
sional display 2510 displays a two-dimensional image 
for an intermediate three-dimensional image, and a two- 
dimensional display 2511 displays a two-dimensional 
image for a rear three-dimensional image.. Shutters 

as 2515-2517 are operated to project these two-dimen- 
sional images sequentially on a time division basis onto 
a screen 2505. 

[024$] Then, the two-dimensional images displayed 
on She screens 2504, 2505 are arranged on the same 

40 optical axis by half mirrors 2502, 2053. 

[0247] in this embodiment, the brightness of each of 
the two-dimensional images projected from the two^Ji- 
mensional displays 2506-251 1 is preset to a desired 
brightness level corresponding to the depth position of 

45 the two-dimensional image displayed 

[0-0023] 
[Embodiment 11] 

so 

[0248] Fig. 39 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
cording to a Seventh embodiment of the invention. Ref- 
erence number 2601 represents an observer 2602 and 
ss 2603 half mirrors, 2604 and .2605 screens, 2606-2611 
two-dimensional displays, 2612-1617 shutters, and 
261 8-2623 beam attenuating filters. 
[0249] The three-dimensional display of this ernbodi- 



19 



37 



EP 0 959 377 A2 



38 



merit differs from the three-dimensional display of the 
preceding tenth embodiment in that the brightness of 
each of the two-dimensional images displayed on the 
two-dimensional displays 2606-2611 is changed by 
beam attenuating filters 2618-2623 installed at the front 
of the two-dimensional displays 2606-2611, 
[0250] For example, when three three-dimensional 
images are reproduced at positions shifted in the direc- 
tion of depth by using the two-dimensional displays 
2606-2608 that display two-dimensional images on the 
front image plane and the two-dimensional displays 
2609-261 1 that display two-dimensional images on the 
rear image plane, the brightness of each two-dimen- 
sional display can be set constant and therefore the 
beam attenuating filters 26 1 3-2623 may have fixed lev- 
els of attenuation. 

[C-0024] 

[0251] Whenthreeorrnore three-dimensional images 
are reproduced at positions shifted In the direction of 
depth, the beam attenuating filters 2618-2623 may be 
a filter that continuously changes its light intensity atten- 
uation by mechanical rotation , a filter that electrically at- 
tenuates light intensity by liquid crystals, a device that 
has slits having changing opening areas and arranged 
in the direction of rotation and which mechanically ro- 
tates the slits to change the brightness, and a device 
which changes the opening time by a ferroelectric shut- 
ter to change the brightness, 
[0252] The attenuation of the beam attenuating filters 
2618-2623 is synchronized with the two-dimensional 
images projected from the two-dimensional displays 
2606-2611 to produce three-dimensional images. 

[C-0025] 

[Embodiment 12] 

[0253] Fig. 40 is a schematic diagram showing the 
outline. configuration of a three-dimensional display ac- 
cording to a twelfth embodiment of the present inven- 
tion. Reference numeral 2701 denotes an observer, 
.2702-2707 half mirrors, 2708-2713 two-dimensional 
displays, and 2714-2719 shutters. 
[0254] Inthethree-dEmensionai display of this embod- 
iment, the light axes of the two-dimensional displays 
2708-2710 are aligned with each other by the half mir- 
rors 2704, 2705, and the two-dimensional images dls- 
played on the two-dimensional displays 2708-2710 are 
projected onto the front image plane by the shutters 
271 4-2716 on a time division basis. The light axes of the 
two-dimensional dismays 2711-2713 are aligned with 
each other by the half mirrors 2706, 2707, and the two- 
dimensional images displayed on the two-dimensional 
displays 2711-2713 are projected onto the rear image 
plane by the shutters 2717-271 9 on a time division ba- 
sis. 



[C-0026] 

[0255] For the two-dimensional displays 2708-2713, 
a CRT, a Nquid crystal display and a plasma display may 
s be used. When a taster speed is required, a display us- 
ing ferroelectric liquid crystals or antifenroelectric liquid 
crystals may be used. 



[0256] Alternatively, it is possible to use a display that 
allows high-speed random access to individual pixels, 
such as a display of oscilloscope. 
[0257] In this case, the brightness leveis of two-di- 
is mensional images displayed on the two-dimensional 
displays 2708-271 3 are changed by the two-dimension- 
al displays 270B-2713 themselves. 



[0£$$] Fig. 41 is a schematic diagram showing the 
outline configuration of a three-dimensional display ac- 
& cordiogtoa thirteerrth embodiment of the invention. Ref- 
erence number 2801 denotes an observer, 2802-2607 
half mirrors, 2808-2813 two-dlmensionai displays, 
271 4-271 9 shutters and 2720-2725 beam attenuating 
filters. 

so [0259] The three-dimensional display of this embodi* 
ment differs from the three-dimensional display of the 
preceding twelfth embodiment in that the brightness of 
each of the two-dimensional images displayed on the 
two-dimensional displays 2808-281 3 is changed by the 

35 beam attenuating filters 2720-2725 disposed at thefront 
of the two-dimensional displays 2S08-2B1 3. 
[0260] For example, whsn three three-dimensional 
images are reproduced at positions shifted in the direc- 
tion of depth by using the two-dimensional displays 

40 2808-2810 that display two-dimensional images on a 
front image plane and the two-dimensional displays 
2811-2813 that display two-dimensional images on a 
rear image plane, the brightness of each two-dimen- 
sional display can be set constant and therefore the 

45 beam attenuating filters 2720-2725 can use fixed levels 
of attenuation. 

[C-0029] 

so [0261] When three ormore three-dimensional images 
are reproduced at positions shifted in the direction of 
depth, the beam attenuating filters 2720-2725 may be 
a filter that continuous ly changes its light intensity atten- 
uation by mechanical rotation, a filter that electrically at- 
ss tenuates light intensity by liquid crystals, a device that 
has slits having changing opening areas and arranged 
in the direction of rotation and which mechanically ro- 
tates the slits to change the brightness, and a device 



[C-0027] 

10 



[C-0028] 

20 

[Embodiment T3j 



so 



ss 
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which changes the opening time by a ferroelectric shut- 
ter to change the brightness. 
[0262] The attenuation of the beam attenuating filters 
2720-2725 Is synchronized with the two-dimensional 
images projected from the two-dimensional displays 
2808-281 3 to produce three-dimensional images. 

[C-0030] 

[0263] The invention has been described in detail In 
conjunction with embodiments. It should be noted, how- 
ever, that the invention is not limited to the embodiments 
but various modifications may be made without depart- 
ing from the spirit of the invention. 

[C-0031] 

[0264] The advantages and effects produced by the 
representative embodiments described in this specifica- 
tion may be summarized briefly as follows, 

[C-0032] 

[0265] With this invention, a plurality of objects which 
have different depth positions and overlap each other 
on the -line of sight of an observer can be represented 
by three-dimensional images in such a way that all the 
three-dimensional images can be seen by the observer 
without being hidden by the front images. 

[D-0020] 

[Embodiment 14] 

[0266] The three-dimensional display according to a 
fourteenth embodiment of the present invention repre- 
sent the overall depth posit ion of the entire three-dimen- 
sional object between a plurality of image focusing 
planes. 

[0267] Fig. 42 shows the outline configuration of the 
three-dimensional display of thefourteenth embodiment 
of the invention. This three-dimensional display includes 
a two-dimensional display 3100, a polarization varying 
device 3101 and a polarization type bifocal optical sys- 
tem 31 Q2, 

[0268] The display light of a two-dimensional image 
displayed on the two-dimensional display 3100 is split 
and displayed onto two image focusing planes (in Fig. 
42, image focusing planes 3103 and 3104) of the polar- 
ization type bifocal optical system 31 02 at a brightness 
ratio that depends on a polarization direction of exit light 
from the polarization varying device 31 01 . 
[0269] When the polarization direction ol exit light 
agrees with one of intrinsic polarization directions 
(meaning two Independent polarization directions) Pi! of 
the polarization type bifocal optical system 3102, the 
two-dimensional image displayed on the two-dimen- 
sional display 3100 is focused on t for example, the im- 



age focusing plane 3103. When the polarization direc- 
tion of the exit light matches the other intrinsic polariza- 
tion direction PI 2, the two-dimensional image displayed 
on the two-dimensional display 3100 is focused on the 

s image focusing plane 3104, 

[0270] When the polarization direction is other than 
these two intrinsic polarization directions (including lin- 
ear polarization, circular polarization, elliptical polariza- 
tion, etc,), the brightness levels of the Image focusing 

to planes 3103 and 3104 are set according to a ratio of 
components of the exit light polarization direction as pro- 
jected onto the orthogonal intrinsic polarization direc- 
tions. 

■«? [D-0021] 

[0271] Among the two-dimensional displays 31 00 are 
a CRT display, a liquid crystal display, an LED display, 
a plasma display, an FED display, a projection type dis- 
ss play and a line drawing type display 

[0272] An example of the polarization varying device 
31 0 1 includes a device using liquid crystals and a device 
using PLZT which has birefringence and can control the 
birefringence by an electric field. These devices will be 
25 described later. 

[0273] Further, an example of the polarization type bi- 
focal optica] system 3102 includes a device using liquid 
crystals and a device which has two optical systems with 
image focusing planes different from those of the polar- 
30 ization beam splitter or two optical systems with image 
focusing planes different from those of the beam splitter 
and the polarizer. These devices will be described later. 

[D-Q022] 

ss 

[0274] The basic operation of the three-dimensional 
display of this embodiment will be explained. 
[027S] In the three-dimensional display of this embod- 
iment, as shown in Fig. 43, a three-dimensional object 

to 3106 to be presented to an observer 31 05 is projected 
along the line of sight of both eyes of the observer 31 05 
onto image focusing planes 31 03, 31 04 to form two-di- 
mensional Images 31 07 f which are then displayed on 
the two-dimensional displays 3100 shown in Fig. 42. 

■*£ [0276] The two-dimensional images 3107 may be 
generated in a variety of ways, which include a method 
that uses two-dimensional images of the three-dimen- 
sional object 31 06 shot by camera from the direction of 
line of sight; a method that synthesizes a plurality of two- 

50 dimensional images shot from different directions; or a 
method that uses synthesizing and modeling tech" 
niques based on computer graphics. 

[D-0023] 

SB 

[0277] Each polarization varying element of the polar- 
ization varying device 3101 is related to one or more 
groups of pixels on the two-dimensional display 31 00. 
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[0278] For example, as shown in Fig. 44, one pixel 
3110 of the two-dimensional display 3100 is related to 
one polarization varying element 3111 of the polariza- 
tion varying device 3101. Or, as shown in Fig. 45, a plu- 
rality d pixels 120 of the two-dimensional display 31.00 
are related to one polarization varying element 3121 of 
the polarization varying device 31 01 . 

[D-0024] 

[Q27SJ Next, the exit light polarization direction of the 
polarization varying element (for example, 3111 of Fig. 
44 or 3121 of Fig. 45) of the.po.larization varying device 
3101 is changed according to the depth position of that 
part of the three-dimensional object 3106 which corre- 
sponds to the associated pixel (e,g„ 3110 in Fig. 44) or 
pixels [e.g., 3120 in Fig, 45) of the two-dimensional dis- 
play 3100. 

[0280] This causes two-dimensional images with 
brightness levels corresponding to the exit light polari- 
zation direction to be displayed on the image focusing 
planes 3103 and 3104, 

[0281] The positional relation of the image focusing 
planes 3103, 3104 is adjusted in advance by using an 
appropriate optical system so that the images on the im- 
age focusing planes 31 03, 3104 overlap each other on 
the line of sight of the observer 3105. 
[0282] Overlapping the Images of the image focusing 
planes 3103, 3104 on the line of sight of the observer 
3105 can be realized by putting the centers or gravity 
centers of tie two<3imensionanmages : 3107 on the line 
of sight, 

[D-0025] 

[0283] The essential point of the three-dimensional 
display of this embodiment Is that, by changing the exit 
light polarization direction of each polarization varying 
element of the polarization varying device 3101, the 
brightness of each part of the Images on the image fo- 
cusing planes 3103, 3104 is changed according to the 
depth position of the three-dimensional object 3106 
while keeping constant the overall brightness as seen 
by the observer 31 05. 

[0284] One example method of changing the bright- 
ness is explained below by referring to Figs. 46 to 49. 
[028S] It is assumed that the image focusing plane 
31 03 is located closer to the observer 31 05 than the im- 
age focusing plane 31 04 and that the intrinsic polariza- 
tion directions of the polarization typebifocalopticalsys- 
tem 31 02 for the image focusing planes 3103, 31 04 are 
taken as pll andpl2. 

[0286] As shown in Fig. 46, when the exit light polar- 
ization direction of each polarization varying element of 
the polarization varying device 3101 coincides with pll, 
the brightness of the image on the image focusing plane 
3103 becomes equal to the brightness of the three-di- 
mensional object 31 06 and the brightness of the image 



on the image focusing plane 31 04 becomes zero, thus 
representing the three-dimensional object 3106 posi- 
tioned. on the image focusing plane 31 03. 
[0287] Next, as shown In Fig. 47, as the exit light po- 

$ larization direction of each polarization varying element 
of the polarization varying device 31 01 is tilted from pll, 
the brightness of the image on the image f ocusing plane 
31 03 slightly lowers from that of Fig. 46 and the bright- 
ness of the image on the image focusing plane 3104 

to increases, thus representing the three-dimensional ob- 
ject 31 06 that has moved slightly away from the image 
focusing plane 3103 toward the image focusing plans 
3104 

rs [D-0026] 

[028S] Further as shown in Fig. 43, when the exit light 
polarization direction of each polarization varying ele- 
ment of the polarization varying device 3101 is further 

20 tilted from that shown in Fig. 47, the brightness of the 
image on the image focusing, plane 3103 further de- 
creases from that of Fig. 47 and the brightness of the 
Image on the image focusing plane 31 04 further increas- 
es, thus representing a situation where the three-dimen- 

-25 sional object 31 06 has moved further away from the im- 
age focusing plane 3103 toward the image focusing 
plane 3104. 

£0289] Finally, as shown in Fig, 49, when the exit light 
polarization direction of each polarization varying ele- 

30 ment of the polarization varying device 3101 coincides 
with ptfi, the brightness of the image on the image fo- 
cusing plane 3104 becomes equal to the brightness of 
the three-dimensional obiect 3106 and the brightness of 
the image on the image focusing plane 3103 becomes 

3S zero, thus representing a situation where the three-di- 
mensional object 3106 is on the image focusing plane 
3104. 

[D-0027] 

40 

[0290] With the above representation method, the ob- 
server 3106 perceives the three-dimensiona! object 
3106 to be located between the image focusing planes 
3103 and 3104 because of observer's physiological or 
& mental factors or optical illusion although the images are 
actually displayed on the image focusing planes 3103, 
3104. 

[0291] Because, unlike the conventional three-dimen- 
sional display, the three-dimensional display of this en> 

so bodiment has at least two image displaying planes on 
the near and far sides of the optical Illusion position, it 
is possible to suppress contradictions among the binoc- 
ular parallax, convergence and focusing - the problem 
experienced with the conventional three-dimensional 

$$ display -- which in turn is expected to reduce eyestrains. 
[0292] Further, because, unlike the conventional 
three-dimensional display, the three-dimensional object 
even at an intermediate position between the image 
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pianos appears threerdimensional to the observer, this 
embodiment has the advantage of being able to provide 
a realistic three-dimensional image representation, not 
the kind of conventional solidity presented by gathering 
sheet-divided depths. 

[0293] The three-dimensional display of this embodi- 
ment also has the advantage of being able to significant- 
ly reduce the amount of data required lor three-dimen- 
sional representation because it can represent even a 
three-dimensional object disposed between a plurality 
of planes. 

[D-0028] 

[02943 Because the three-dimensional display of this 
embodiment utilizes human physiological or mental fac- 
tors or optical illusion based on changes in image bright- 
ness, there Is an advantage that a coherent light source 
such as a laser is not required and that a color stereo- 
scopic image representation can be easily realized. 
[0295] Further, because the three-dimensional dis- 
play of this embodiment does not include mechanical 
driving parts, it has tie advantage of light weight and 
improved reliability. 

[02961 Further, because the two-dimensional repre- 
sentation is achieved by the two-dimensional display 
3100 and the depthwise representation is achieved by 
the polarization varying device 3101 , this embodiment 
has the advantage of simple control, 
[0297] Further, because the resolutions of imagescan 
be differentiated, the amount of information can be re- 
duced. That Is, in view of the fact that the resolution re- 
quirement for the depth direction is lower than that for 
the two-dimensional direction, it may be an effective 
method to reduce the resolution in the depth direction. 

[D-0029] 

[D298] lathe three-dimensional display of this embod- 
iment, the size of the device is not restricted by the po- 
sition, interval and size of the image focusing planes. 
[0299] That is, it is possible to locate the image focus- 
ing planes 3 1 03, 31 04 at the front side of the three-di- 
mensional display as virtual planes by an opticaE sys- 
tem, or at the rear side by another optical system. 
[0300] The image focusing planes3103, 3104can be 
spaced aparta greaterdistance than in this embod iment 
by an optical system. 

[0301] Further, the size of the formed images can also 
be made larger than In this embodiment by an optical 
system, 

[0302] Thus, compared with a method in which dis- 
plays are actually arranged, this embodiment has the 
advantage of being able to reduce the overall size of the 
three-dimensional display. 



[P-0030] 

[0303] Trie above description concerns a case where 
the brightness levels of the two-dimensional images 

5 3107 on a plurality of image focusing planes 3103, 3104 
are changed while Keeping constant the overall bright- 
ness as seen by the observer. It is a common technique 
employed in computer graphics to progressively reduce 
the overall brightness as seen by the observer 3105 to- 

f 0 ward the far side in order to make the image look solid, 
tt is obvious that the use of this technique also in this 
embodiment can further enhance the three-dimensional 
effect. 

[0304] Sequentially changing the two-dimensional 
images 31 07 and the polarization direction of the display 
light of the two-dimensional images 3107 and throwing 
it onto a plurality of image focusing planes 3103, 3104 
at different depth positions can generate athree-dimen- 
sional video image, 

20 [0305] While this embodiment has described a case 
where the three-dimensional object 3106 to be repre- 
sented is displayed as two-dimensional images on two 
image focusing pfanes 3103, 3104, it is apparent that 
the similar effects can be expected if more than two im- 

£5 age focusing planes are used. 

[0300] This embodiment has described only the basic 
configuration and it is apparent that aberration can be 
reduced by adding optical systems. 
[0307] Further, this embodiment has described a case 

30 where an observer 3105 is located at the front center of 
the three-dimensional display. If the observer 310 Is lo- 
cated at other positions, it is apparent that the similar 
effects can easily be produced by changing or adding 
optical systems. 

$$ 

[D-0031] 

[Embodiment 15] 

40 [0303] The three-dimensional display according to a 
fifteenth embodiment of the invention differs from the 
preceding embodiment in that the three-dimensional 
display represents the depth of the three-dimensional 
object itself. 

45 [03O9J Fig. 50 shows the outline configuration of the 
three-dimensional display of the fifteenth embodiment 
of the invention. The three-dimensional display, as with 
the fourteenth embodiment, includes a two-dimensional 
display 3200, a polarization varying device 320 1 and a 

so polarization type bifocal optical system 3202. 

[0310] In the three-dimensional dlsplayof this embod- 
iment, too, the display light of a two-dimensional image 
displayed on the two-dimensional display 3200 is split 
and displayed onto two image focusing planes (in Fig. 

55 50, image focusing planes 3203 and 3204) of the polar- 
ization type bifocal optical system 3202 at a brightness 
ratio that depends on a polarization direction of exit light 
from the polarization varying device 3201 . 
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[D-0032] 

[0311] The basic deration of the three-dimensional 
display of this embodiment will be explained as follows. 
[0312] First, the two-dimensional images 3207 of a 
three-dimensional object to be represented are dis- 
played on the two-dimensional display 3200. 
[0313] Then, as shown in Figs. 44 and 45, each po- 
larization varying e Semen! of the polarization varying de- 
vice 3201 is related to one or more pixels of the two- 
dimensional display 3200, 

[0314] Next, the exit light polarization direction of the 
related polarization varyin g element is changed accord- 
ing to the depth position of that part of the three-dimen- 
sional object which corresponds to the associated pixel 
(e,g., 31 10 in Fig. 44) or pixels (e.g., 3120 in Fig, 45) ol 
the two-dimensional display 3200, 
[0315] This causes two-dimensional [mages with 
brightness levels corresponding to the exit light polari- 
zation direction to be displayed on the image focusing 
planes 3203 and 3204 

[0316] The positional relation of the image focusing 
planes 3203, 3204 Is adjusted in advance by using an 
appropriate optical system so that the images on the im- 
age focusing planes 3203, 3204 overlap each other on 
the line of sight of the observer 3205. 

[0-0033] 

[0317] The essential point of the three-dimensional 
display of this embodiment is that, by changing the exit 
light polarization direction of each polarization varying 
element of the polarization varying device 3201, the 
brightness of each part of the images on the Image fo- 
cusing planes 3203, 3204 is changed according to the 
depth position of each part of the three-dimensional ob- 
ject white keeping constant the overall brightness as 
seen by the observer 3205. 
[031S] One example method of changing the bright- 
ness is explained below by referring to Figs, 51 A and 
51 B. 

[0319] Fig. 51 A show an example image formed on 
an image focusing plane close to the observer, for ex- 
ample image focusing plane 3203, and Fig. 51 B repre- 
sents an example image formed on ah Image focusing 
plane remote from the observer, for example image fo- 
cusing plane 3204. 

[0320] When a cake, as shown In Figs. 51 A and 51 B, 
is taken as an example object, the top and bottom sur- 
faces of the cake is almost flat except for candles stuck 
on the top, the wafl surface is cylindrical, and the candles 
arearranged near the circumference of the top surface 
of the cake. 

[0321] As shown in Figs. 51 A and 51 B, in the two-di- 
mensional images 3207, on the top andbottom surfaces 
the upper parts represent the remote parts of the cake. 
On the wail surface, the central pari of the wall surface 
corresponds to the near side of the cake, and as you go 



from the center toward the left and right, the surface po- 
sition moves toward the far side, And the central part of 
the hidden wall surface, which is shown higherthan the 
front wail surface, is located on the far side. 
5 [0322] in this case, polarization direction of each part 
needs to be changed by considering the two intrinsic po- 
larization directions of the polarization type bif ocal opti- 
cal system 3202 so that the brightness levels of the im- 
age focusing planes 320.3, 3204 will change as follows. 

[D-00.34] 

[0323] First, the brightness on the top and bottomsur^ 
faces Is progressively changed according to the depth 
position so that, as shown in Fig. 51 A, on an image fo- 
cusing plane 3203 close to the observer 3205 a portion 
close to the observer 3205 (a lower part of the two-di- 
mensional image 3207) has a higher brightness level 
and a portion remote from the observer (an upper part 
of the two-dimensional image 3207) has a lower bright- 
ness level. 

[0324] Further, on an image focusing plane 3204 re- 
mole from the observer 3205, the brightness is progres- 
sively changed according to the depth position so that, 
as shown in Fig. 51 B, a portion close to the observer 
3205 (a lower part of the two-dimensional image 3207) 
has a lower brightness level and a portion remote from 
the observer {an upper part of the twoHdimenstonai im- 
age 3207) has a higher brightness level, 
[0325] Next, the brightness of the cylindrical portion 
is also changed progressively according to its depth po- 
sition so that, on an image focusing plane close to the 
observer 3205, a portion close to the observer 3205 
(around thecenter)has a higher brightness level and a 
portion remote from the observer (near the left and right 
end) has a lower brightness level, as shown in Fig. 51 A. 
[032£| On an image focusing plane 3204 remote from 
the observer 3205, the brightness is changed progres- 
sively so that, as shown in Fig. 51 B, a portion close to 
the observer 3205 (around the center) has a lower 
brightness level and a portion remote from the observer 
(near the left and right end) has a higher brightness lev- 
el. 

[0327] In Figs. 51 A and 51 B, the darker the image is 
shaded, the higher the brightness level it represents. 
[0328] With the above representation method, the ob- 
server 3205 perceives as if there is a cylindrical cake 
with almost flat top and bottom surfaces because of ob- 
servers physiological or mental factors or optical illusion 
although what is actually shown to the observer is two- 
dimensional images. 

[0329] With this three-dimensionai display of this em- 
bodiment, it is possible to easily .represent a three-di- 
mensional object having a continuous depth. 
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[CM3035J 
[Embodiment 16] 

[0330] A polarization type bifocal optical system that 
can be used in the three-dimensional displays of the pre- 
ceding embodiments will be explained. 
[0331] Fig. 52 shows examples of the polarization 
type bifocal optical system that can be used in the three- 
dimensional displays of the preceding embodiments, 
[0332] The polarization type bifocal optical systems 
represented by reference numerals 3310-3313 in Fig. 
52 each have a fixed focus lens 330 1 and a birefringent 
area 3302. 

[0333] The fixed focus lens 330 1 is formed by, for ex- 
ample, a convex lens of glass or plastics as shown in a 
polarization type bifocal optica! system 3313; a concave 
lens of glass or piastics as shown in a polarization type 
bifocal optical system 331 2; or a lens system combining 
convex lens, concave lens and prism of glass or plastics 
or a mirror system combining convex lens, concave lens 
and prism as shown in polarization type bifocal optical 
systems 3310, 3311 , respectively. 
[0334] The birefringent area 3302 is formed ol, for ex- 
ample, a medium of liquid crystals or PLZTthat has bi- 
refringence. 

[P-0036] 

[0335] Here, it Is assumed thai the refractive index of 
the fixed focus lens 3301 is nl, that the intrinsic polari- 
zation directions in the birefringent area 3302 are p21 
and p22, and that the refractive indices in these polari- 
zation directions are n21 and n22, 
[0336] When, for example, light enters from the bire- 
fringent area 3302, the incident light is split into polar- 
ized light beams having polarization directions of p21 
and p22 according to the polarized state. The polarized 
beams propagate according to the refractive indices 
n21, n22 they sense, and contact the fixed focus lens 

3301 of the refractive index of n1 . 

[03371 As shown in Fig. 53, the two polarized light 
beams, which remain split as they go out, form images 
at different positions according to the difference in the 
refractive index. That is, this optical system works as a 
bifocal optical system that splits light beam according to 
the polarization directions, 

[0338] Conversely when light enters from the fixed fo- 
cus lens 3301 side, the light is split according to the re- 
fractive indices associated with the intrinsic polarization 
directions and forms images on two different image fo- 
cusing planes. 

[D-Q0371 

[0339] As shown in Fig. 52, when the birefringent area 

3302 il liquid crystals, the addition of an alignment layer 
3303can ensure uniform in-plane splitting of light enter- 



ing from the birefringent area 3302 side. 
[0340] Even when the alignment layer 3303 is provid- 
ed on oniy one of the birefringent areas 3302, the Inci- 
dent light becomes twisted by its own optical activity ae- 

$ cording to the alignment of the birefringent medium. Be- 
cause the refractive indices that the split light beams 
sense do not change, the aforementioned effect will also 
be produced without problem. 
[0341] Providing an alignment layer also on the side 

10 of an interface with the fixed focus lens 3301 is effective 
when light is thrown in from the fixed focus lens 3301 
side or when such alignment-dependent optical sys- 
tems are connected in series. 

« [D-0G38] 

[0342] In the polarization type bifocal optical systems 
shown in Figs. 52 and 53, even when the fixed focus 
lens 3301 is not provided, it is obvious that if one or both 
20 sides of the birefringent area 3302 are formed in a lens 
or prism shape as shown in Fig. 54, the effects similar 
to those shown in Figs 52 and 53 can be produced. 
[0343] Liquid crystal are useful as a birefringent me- 
dium because of their large. refractive anisotropy, Appli- 
es cable kinds of liquid crystals include ordinary nematic 
liquid crystal, polymer dispersed liquid crystal, holo- 
graphic polymer dispersed liquid crystal, polymer liquid 
crystal, smectic liquid crystal, ferroelectric liquid crystal, 
and polymer stabilized ferroelectric liquid crystal. 
30 [0344] Further, it is obvious that birefringence can al- 
so be obtained with polymer materials other than liquid 
crystals by aligning the major axes of the polymer ma- 
terials during forming. 

35 [D-0039] 

[Embodiment 17] 

[0345] Fig. 55 shows other examples of the poiarrza- 
40 tion type bifocal optical system that can be used in the 
three-dimensional displays of the preceding embodi- 
ments. 

[0346] The polarization type bifocal optical system 
shown in Fig. 55 comprises: a polarizing beam splitter 
45 3401 for splitting a beam on the incoming side- two op- 
tical systems 3402, 3403 with different focal lengths; a 
polarizing beam splitter 3404 for synthesizing on the 
outgoing side; and plane mirrors 3405, 3406 for bending 
a light path. 

50 [0347] The two optical systems 3402, 3403 are 
formed, for example, by convex lens, concave lens, 
prism, convex/concave mirror or plane mirror or a com- 
bination of these, 

[0348] In the polarization type bifocal optical system 
5S shown in Fig. 55, incident light is split by the polarizing 
beam splitter 3401 into two intrinsic polarized beams 
p41, p42 at a brightness ratio that corresponds to their 
polarization directions, and then fed into the optical sys- 
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terns 3402, 3403. 

[0349] The optical systems 3402, 3403 have different 
focal lengths and thus the incident polarized beams p41 , 
p42 have different image forming distances. 
[0350] Therefore, when both of the polarized beams 
p41 , p42 are synthesized bythe polarizing beam splitter 
3404, the two intrinsic polarized beams p41 , p42 form 
images on different image focusing planes 3407, 3403. 
[0351] In this way, the optical system shown in Fig. 55 
can form a polarization type bifocal optical system that 
can split light at a brightness ratio that corresponds to 
the polarization directions. 

[0352] Here it is obvious that the similar effects can 
be produced if an optica! system including the configu- 
ration shown in Fig. 56 is used instead of the polarizing 
beam spittter 3401 . 

[0353] That is, the configuration of Fig, 56 includes 
polarizing plates 3411 , 3412 whose polarization direc- 
tions are perpendicular to that of the beam splitter 341 0 
[e.g., semitransparent mirror and semitransparent 
prism) . This configuration provides the similar effects. 
[0354] It is also possible to use an optical system hav- 
ing the configuration shown in Fig. 56 instead of the po- 
larizing beam. splitter 3404, 

EP-Q040] 

{Embodiment 16] 

[0355] The polarization varying device that can be 
used in the three-dimensional displays of the preceding 
embodiments wiE| be explained. 
[0356] A well known example of device that can 
change the polarization direction of incident light, as do 
the polarization varying devices used in the three-di- 
mensional displays of the preceding embodiments, is a 
device that uses a medium (e.g., liquid crystals and 
PLZT} capable of changing birefringence by electric 
field and voltage, 

[0357] Many kinds of devices using liquid crystals are 
described in "Liquid Crystals, Basics" and "Liquid Crys- 
tals, Applications" (by Okano and Kobayashi, published 
by Baifukan). 

[0358] Major examples are explained below by refer- 
ring to Figs. 57 to S3A and 62B. 
[0359] Fig. 57 shows the outline configuration of a 
twisted nematic type polarization varying device that 
can be used in the three-dimensional displays of the pre- 
ceding embodiment. 

[0360] The twisted nematic type polarization varying 
device shown in Fig. 57 Includes a transparent conduc- 
tive layer (transparent electrode ) 3.501 , an alignment 
layer 3502, a nematic liquid crystal region 3503, an 
alignment layer 3504, and atransparent conductive lay- 
er (transparent electrode )3505. 
|0361 J It is common that the orientation directions of 
the alignment layers 3502 and 3504 are set perpendic- 
ular to each other and that a chiral material is added so 



that the liquid crystal molecules are twisted or describe 
a spiral in the same direction. 

[D-0041] 

5 

[0362] As indicated by reference number 3510 in Fig. 
56, when no voltage is applied between the transparent 
conductive films 3501 and 3505, the crystal molecules 
rotate 90 degrees to described a spiral by the orientation 

10 restriction force of the alignment layers 3602, 3504 and 
the effect of the chiral material. 
[0363] The linearly polarized Incident light therefore 
has its polarization direction changed almost 90 de- 
grees by the optical activity of the liquid crystals {one of 

15 the properties of the birefringent material) before going 
out of the liquid crystals, 

[0-0042] 

so |0364] When a voftage VS sufficiently higher than the 
threshold voltage is applied between the transparent 
conductive films 3501 and 3505, the liquid crystal mol- 
ecules are aligned In the voltage application direction, 
as indicated by reference numeral .3511* 
25 [0365] Hence, the incident light goes out almost with- 
out changing the polarization direction, 
[0366] When the voltage applied between the trans- 
parent conductive films 3501 and 3505 is V5 or lower, 
a continuous change in polarization direction according 
M to the applied voltage is obtained, 

[0367] In this way, the polarization direction of the in- 
cident light can be changed by the voltage applied be- 
tween the transparent conductive films 3501 and 3505, 
[0366] Furthar 3 jl is also a well known practice to an- 
as range these constitutional elements in matrix and drive 
them by using active drive elements. 

[D-0043] 

40 [0369] Fig. 59 shows the outline configuration of an 
in-plane type polarization varying device that can be 
used in the two-dimensional displays of the preceding 
embodiments. 

[0370] The in-plane type polarization varying device 
45 includes a transparent conductive film (transparent 
electrode) 3601 , an alignment layer 3602, a nematic liq- 
uid crystal region 3603, an alignment layer 3604, and a 
transparent conductive film (transparent electrode) 
3605, 

so [0371] Here the orientation directions of the alignment 
layer .3602 and the alignment layer 3604 are parallel, 
and the transparent conductive films 3601 and 3605 are 
in the same plane. 

[0372] As shown by reference numeral 3620 In Fig. 
55 60, when no voltage 3s applied between the transparent 
conductive films 3601, 3605, the liquid crystal molecules 
are aligned in the orientation direction by the orientation 
restriction force of the alignment layers 3602, 3604. 
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[0373] When, asshown by reference numeral3521 in 
Fig, 6.0, a voltage V6 sufficiently higher than the thresh- 
old voltage is applied between the tTansparent conduc- 
tive films 3601 and 3605, the liquid crystal molecules 
are aligned in the direction of voltage application, 
[0374J Because the direction in which the liquid crys- 
tal molecules having birefringence are aligned is 
changed in this way, the polarization state of the exit light 
can be changed, 

[0375] Further, when the voltage applied between the 
transparent conductive films 3601 and 3605 is V6 or 
lower, a continuous change in polarization direction ac- 
cording to the applied voltage is obtained, 
[0376] It is also a well known practice to arrange these 
constitutional elements in matrix and drive them by us- 
ing active drive elements.. 

[0377] Fig. 61 shows the outline configuration of a ho- 
mogeneous type polarization varying device that can be 
used in the three-dimensional displays of the preceding 
embodiments, 

[03781 The homogeneous type polarization varying 
device shown In Fig. 61 Includes a transparent conduc- 
tive film (transparent electrode) 3611, an alignment lay- 
er 3612, a. liquid crystal (e.g., nemstic liquid crystal) re- 
gion 3613 t an alignment layer 3614, and a transparent 
conductive film (transparent electrode) 361 5, 
[0379] in the homogeneous type polarization varying 
device shown in Fig. 61, because homogeneously 
aligned liquid crystals are used, the orientation direc- 
tions of the alignment layers 3612 and 3614 are set 
equal (parallel). 

[0380] Further, in the homogeneous type polarization 
varying device shown in Fig. 61, light is entered whose 
polarization direction is deviated from the orientation di- 
rection of the alignment layer. 
[0381] For example, as shown in Fig. 62A, when inci- 
dent light is linearly polarized, its polarization direction 
is shifted toward an intermediate direction between 0 
and 90° (for example 45°) when the Kght is thrown into 
the homogeneous type polarization varying device 
shown in Fig. 61 . 

[0382] Further, as shown in Figs. 62B and 62C, inci- 
dent light which is circularly polarized or eiliptically po- 
larized is entered into the homogeneous type polariza- 
tion varying device shown in Fig, 61 . 
[0383] When, as shown in Fig. 63B, a voltage V7 suf- 
ficiently higher than the threshold voltage is applied be- 
tween the transparent conductive films 3611 and 3615, 
the liquid crystal molecules are aligned in the direction 
of voltage application. 

[0384] Therefore, the incident light goes out almost 
without changing the polarization direction. 
[0385] On the other hand, when no voltage is applied 
between the transparent conductive films 3611 and 
3615, as shown in Fig. 63A, the liquid crystal molecules 
are aligned in the orientation direction by the orientation 
restriction force of the alignment layers 3612, 3614 and 
also aligned parallel to the alignment iayers 361 2 , 361 4. 



[0.386] Therefore, the incident light goes out with its 
polarization direction changed by the birefringence of 
the liquid crystals. 

[0387] Further, when the voltage applied between the 
5 transparent conductive layers 3611 and 3615 are V7 or 
lower, a continuous change in polarization direction ac- 
cording to the applied voltage Is obtained. 
[038B] In this way, the polarization direction of the in- 
cident light can be changed by the voltage applied be- 
*0 tween the transparent conductive films 3611 and 3615. 
[0389] Further, it is also a well known practice to ar- 
range these constitutional elements in matrix and drive 
them by using active drive elements. 
[0390] There are apparently a variety of apparatuses 
?£ that can use other liquid crystals than nematic liquid 
crystal, such as ferroelectric liquid crystal, polymer dis- 
persed liquid crystal and polymer liquid crystal, and pro- 
duce the similar effects. 

[0391] Although the present Invention has been de- 
20 scribed in detail in conjunction with preceding embodi- 
ments, it should.be noted that the invention is not limited 
to these embodiments and various modifications may 
be made without departing from the spirit of the inven- 
tion. 

2$ 

[D-0044] 

[0392] The representative advantages of this inven- 
tion may be briefly summarized as follows, 
30 [0393] Contradictions among physiological factors 
associated with stereoscopy can be minimized; the 
amount of information required can be reduced; and 
electrically rewritable three-dimensional videos can be 
reproduced, 

35 

[E-0007] 
[Embodiment 19] 

40 [0394] In the following examples, a word "plane" on 
which to put an image is used. This is similar in meaning 
to an image plane that is often used in optics. Means to 
realize such an Image plane can obviously be realized 
by combining many optical devices, which include a va- 

45 riety of optical elements (e.g., lens, total reflecting mir- 
ror, partial reflecting mirror, curved mirror, prism, polar- 
izer and wavelength plate) and two-dimensional dis- 
plays (e.g., CRT, liquid crystal display, LED display, 
plasma display, FED display, DMD display, projection 

50 type display and line drawing type display), 

[0395] The following examples concern a case where 
a three-dimensional object to be presented is displayed 
as two<3imensional images on mainly two planes., if the 
number of planes is Increased to more than two, the sin> 
ilar effect can obviously be expected. 
[0396] Fig. 64 shows the principle of a head-mounted 
display according to a nineteenth embodiment of the 
present invention. 
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[0397J In this embodiment a plurality of planes 4101 , 
41 02 are set in front of an observer 41 00 (with the plane 
4101 put closer to the observer 4100 than the plane 
4102, for example). To display a plurality of two-dimen- 
sional images on these planes, an optical system 41 03 
is constructed by using two-dimensional displays and a 
variety of optical elements. 

(Details will be described in the twentieth and 
subsequent embodiment.) 

[0398] Example two-dimensional displays include 
CRT, liquid crystal display, LED display, plasma display, 
FED display, DMD display, projection type display and 
line drawing type display. Example optical eiements in- 
clude lens, total reflecting mirror, partial reflecting mirror, 
curved mirror, prism, polarizer and wavelengltvplate, 
[0399] The observer 4100 wears fixing means 4110 
to fix relative positions of a plurality of two-dimensional 
images displayed on the planes 41 01 , 4102 with respect 
to left and right eyes of the observer 4100. 

[E-000B] 

[0400] Next, as shown in Fig. 65, a three-dimensional 
object 41 04 to be presented to the observer 41 00 is pro- 
jected onto the planes 4101, 4102 as seen from one 
point on a line connecting the left and right eyes of the 
observer 4100 to form two-dimensional images 4105, 
41 oa 

[0401] The two-dimensional images can be generat- 
ed by a variety of ways, which include a technique that 
photographs the object 4104 by camera from the one 
point described above; a technique that synthesizes a 
plurality of two-dimensional images photographed from 
different directions; or synthesizing and modeling tech- 
niques based on computer graphics, 
[0402] The two-dimensional images 41 05, 41 06 are 
displayed on the planes 41 01 , 41 02 as shown in Fig. 84 
so thai they overlap each other as seen from the one 
point. 

[0403] This can be achieved by putting the centers or 
gravity centers of the two-dimensional images 4105, 
41 06 on the line of sight 

[E-0009] 

[0404] The important point of this embodiment is that, 
on the apparatus having the above configuration, the 
brightness levels of the two-dimensional images are 
changed according to the depth position of the three- 
dimensional object 4104 while keeping constant the 
overall brightness as seen by the observer 4100 (I.e., in 
such a way that the overall brightness as seen by the 
observer 4100 is equal to the brightness of the three- 
dimensional object 41 04). 

[0405] One example method of changing the bright- 
ness level is described below. 



[040$] Figs. 66 to 69 are black and white illustrations 
and, lor simplicity, parts with higher brightness levels are 
shaded darker. 

[0407] For example, when the three-dimensional ob- 
5 Sect 4104 is displayed at adepth position corresponding 
to the position of the plane 41 01 , the brightness of a two- 
dimensional Image 41 05 on the plane 4102 is set equal 
to that of the three-dimensional object 4104 and the 
brightness of the two-dimensional image 41 06 on the 
to plane 4102 is set to zero, as shown in Fig. 66. 

[0408] Next, when the three-dimensional object 4104 
moves slightly away from the observer 4100 and is 
shown at a depth position siightly away from the plane 
4101 and closertothe plane 41 02, the brightness of the 
1* two-dimensional image 4105 is slightly lowered and the 
brightness of the two-dimensional image 4103 is slightly 
raised, as shown in Fig. 67. 

[0409] Further, when the three-dimensional object 
4104 moves further away from the observer 4100 and 
2Q is shown at adepth position further away from the plane 
4101 and cbser to the piane 41 02, the brightness of the 
two-dimensional image 41 05 is further lowered and the 
brightness of the two-dimensional image 4106 is further 
raised. 

25 [0410] Finally, when the three-dimensional object 
4104 is shown at a depth position corresponding to the 
position of the plane 4102, the brightness of the two- 
dimensional image 41 06 on the plane 4102 is set equal 
to that of the three-dimensional object 4104 and the 

$0 brightness of the two-dimensional image 4105 on the 
plane 41 01 is set to zero as shown in Fig. 69 for in- 
stance. 

[0411] Displaying the abject in this manner enables 
the observer 41 00 to feel as if the three-dimensional ob- 

35 jact 4104 is focated between the planes 4101 and4102 
because of observer's physiological or mental factors or 
optical illusion although what is actually shown to the 
observer is the two-dimensional ^905 4105, 4106, 
[0412] That is, when for example the two-dimensionai 

40 images 41 05, 4106 with almost equal brightness are dis- 
played on the planes 4101 and 4102, the three-dimen- 
sional object 4104 looks as if it lies nearto a middle point 
between the depth positions of the planes 41 01 , 41 02. 

*s [E-0010I 

[0413] Particularly when a point between the left and 
right eyes is used as a viewing point on a line connecting 
the left and right eyes of the observer 4100, the reliability 
50 for producing this effect is increased (or simply put, this 
same effect can be produced for a large number of peo- 
ple or most ol the time). 

[0414] Further, when a cenier position between the 
left and right eyes of the observer 4100 is used as the 
55 viewing point, there is an advantage that the same effect 
can be more readily produced and that the size of a dou- 
ble image produced from the planes 4101 , 41 02 for both 
eyes can be reduced. 
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[E-0011] 

[041 S] The above description concerns a method and 
apparatus in which the overall depth position of the 
three-dimensional object 4104 is represented by using £ 
two-dimensional images on the planes 4101 and 4102. 
This embodiment apparent!/ can be applied also as a 
method and apparatus that represents the depth of the 
three-dimensional object Itself. 
[041€1| m ft® case, the brightness level of each part 
of the two-dimensional images 4105, 4106 needs to be 
changed according to the depth position of each corre- 
sponding part of the three-dimensional object 4104 
while keeping constant the overall brightness as seen 
by the observer 41 00 (i. e. , in such a way that the overall 
brightness as seen by the observer 4100 is equal to the 
brightness of the three-dimensional object 4104). 
[0417] For example, the brightness of the two-dimen- 
sional image 41 05 displayed on the plane 41.01 close to 
the observer 4100 Is changed progressively according 
to the depth position of the corresponding part of the 
object so that a portion close to the observer 4100 has 
a higher brightness leveJ and a portion remote trom the 
observer has a lower brightness level. 
[041 8] The brightness of the two-dimensional image 
4105 displayed on the plane 4102 remote from the ob- 
server 41 00 is progressively changed according to the 
depth position of the corresponding part of the object so 
that a portion close to the observer has a lower bright- 
ness level and a portion remote from the observer has 
a higher brightness level. 

[0419] Displaying the object in this manner enables 
the observe r 41 00 to feel as if the object presented has 
a solid body with some depth because of observer's 
physiological or mental factors or optical illusion al- 
though what is actually shown to the observer is two- 
dimensional images. 

[E-0012] 

[0420] Unlike the conventional apparatus (planar dis- 
play), this embodiment has at feast two image display 
planes on the near and far sides of the optical illusion 
position , so that contradictions among the b inocular par- 
al lax, convergence and focusing - the problem experi- 
enced with the conventional apparatus - can be sup- 
pressed significantly, which In turn is expected to reduce 
eyestrains. 

[0421] As to the focusing, because the observer 4100 
sees two or more planes simultaneously, the focus point 
coincides with the optical illusion position where bofhof 
the images can be seen with minimum blur. 
[0422] Further, because this embodiment can also 
present a three-dimensional object 4104 that exists be- 
tween a plurality of planes, there is an advantage that 
the amount of data required for three-dimensional rep- 
resentation can be reduced substantially 
[0423] Further, because the apparatus of this embod- 



iment is fixedly worn by the observer 41 00, this embod- 
iment has ttie.advantage of being able to easily display 
two-dimensional images according to the movement of 
the observer 4100 or eyes, 

[0424] Although the head-mounted display is basical- 
ly a display that is secured to the bead of the wearer, 
trie present invention can apparently be applied also to 
an apparatus that is not mounted on the head as long 
as the apparatus is so constructed that the positional 
relationship between the eyes of the observer and the 
plane will not be changed 

[0425] Further, because this embodiment makes use 
of human physiological or mental factors or optical illu- 
sion based only on brightness changes of two-dimen- 
sional images, the embodiment does not require the use 
of a coherent light source such as a laser and facilitates 
the color stereoscopic image representation, 
[0426] Further, since this embodiment does not in- 
clude mechanical driving parts, it can suitably reduce 
the Weight of and improve the reliability of the apparatus. 
[0427] This embodiment mainly concerns a case 
where there are only two planes for displaying two-di- 
mensional images and where a three-dimensional ob- 
ject to be presented to the observer 41 00 lies between 
the two planes. It Is, however, apparent that the similar 
configuration can be employed if there are more planes 
or the three-dimensional object 41 04 to be presented is 
located at a different position. 



[0428] This embodiment can obviously display a vid- 
eo : so that an observer can see the motion of an object 
in the horizontal and vertical directions as long as tine 
two-dimensional displays have display speeds compat- 
ible with the video, it Is also apparent that the motion of 
an object in the depth direction can also be presented 
to the observer by changing the brightness of a plurality 
of planes for each frame. 

[0429J In this case, the brightness of each part of the 
two-dimensional images 4105, 41 06 is changed accord- 
ing to a change over time of the depth position of the 
three-dimensional object 4104 while keeping constant 
the overall brightness as seen by the observer 4100 (L 
e.., in such a way that the overall brightness as seen by 
the observer 41 00 is equal to the brightness of the three- 
dimensional object 4104). 

[0430] That Is, when for example the three-dimen- 
sional object 41 04 is on the plane 4101 , the brightness 
of the two-dimensional image 4105 on the plane 4101 
is set equal to that of the th ree-dimensional object 41 04 
and the brightness of the two-dimensional image 4106 
on the plane 4102 is set to zero. 



[0431] Next, when the three-dimensional object 41 04 
progressively moves slightly away from the observer 
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4100 and inches from the plane 4101 toward the ptane 
4102 over time, the brightness of the two-dimensional 
image 4105 is lowered slightly over time according to 
the movement in the depth position of the three-dimen- 
sional object 4104 and at the same time the brightness 
of the two-dimensional image 4106 Is slightly raised 
overtime. 

[0432] Next, when the three-dimensional object 41 04 
moves f urther away from the observer 41 00 and inches 
from the plan.e410l further toward thB plane 4102 over 
time, the brightness of the two-dimensional image 4105 
is lowered further overtime according to the movement 
in the depth position of the three-dimensional object 
4104 and at the same time the brightness of the two- 
dimensional image 4105 is raised further over time. 
[0433] N ext, when the three-dimensional object 41 04 
finally reaches the plane 41 02 over. time, the brightness 
of the two-dimensional image 4106 on the plane 4102 
is changed over time until it becomes equalio the bright- 
ness of the three-dimsnsionaE object 4104 according to 
the movement in the depth position of the three-dimen- 
sional object 41 04 and at the same time the brightness 
of the two-dimensional image 4105 oh the plane 4101 
is changed over time until it becomes zero. 
[0434] Displaying the object in this way enables the 
observer 4100 to feel as if the three-dimensional object 
4104 moves over time from the plane 4101 to the plane 

4102 in the direction of depth because of observer's 
physiological or mental factors or optical illusion al- 
though what is actually shown to the observer is two- 
dimensional images 4105, 4106. 

[0435] It is obvious that, because of the after image 
effect, the above-described effect of this embodiment 
can be produced as long as the two-dim ensionalimages 
are displayed within one frame, whether they are dis- 
played simultaneously or at different timesj or displayed 
simultaneously for one duration and separately for an- 
other duration. 

[0436] Further, this embodiment has an advantage of 
being able to significantly reduce the amount of data re^ 
quired for three-dimensional representation because 
this embodiment can display a stereoscopic represen- 
tation ofathree-dimensional object lying between a plu- 
rality of planes. 

[Embodiment 20] 

[0437] Fig. 70 Illustrates the principle of a head- 
mounted display according to a twentieth embodiment 
of the invention. 

[0438] In this embodiment, a plurality of planes, for 
example, planes 1R1, 1R2, 1L1, 1 L2 are arranged in 
front of the left and right eyes of the observer 4100 (the 
planes 1 R1 , 1 L1 are set closer to the observer 41 00 than 
the planes 1R2, 1L2). To display a plurality of two-di- 
mensional images on these planes, an optical system 

4103 is constructed for each of the left and right eyes 
by using two-dimensional displays and a variety ol op- 



tical elements, (Details will be described in the twenty- 
first and subsequent embodiments.) 
[0439] Examples of the two-dimensional displays in- 
clude CRT, liquid crystal display, LED display, plasma 

s display, FED display, projection type display and line 
drawing type display. Examples of optical elements in- 
clude lens, total reflecting mirror, partial reflecting mirror, 
curved mirror, prism, polarizer and wavelength plate, 
[0440] The observer 41 00 wears a fixing means 41 1 0 

to to fix the relative positions between the plurality of two- 
dimensional images displayed on these planes 1R1, 
1R&1LUL2 and the left and right eyes of the observer 
4100. 

1$ [E-0015] 

[0441 ] Next, as shown in Fig. 71 , a three-dimensional 
object 41 04 to be presented to the observer 41 00 is pro- 
jected onto the planes 1R1, 1R2, 1L1, 1L2, as viewed 
20 from one point on a line connecting the left and right 
eyes of the observer 4100, to form two-dimensional im- 
ages 1R5, 1R6, 1L5.1L6. 

[0442] While Fig. 71 shows the configuration for only 
the right eye, the configuration for the left eye can be 

2s obtained simply by replacing the symbol R with L, 
[0443] The two-dimensional images 1R5, 1R6, 1L5, 
1. LB can be generated by a variety of ways, which In- 
clude atephnique that uses two-dimensional irnages ob- 
tained by photographing the three-dimensional object 

so 4104 by camera in the direction of line of sight; a tech- 
nique that synthesizesa plurality of two-dimensional im- 
ages photographed from different directions; or synthe- 
sizing and modeling techniques based on computer 
graphics. 

& [0444] The two-dimensional images 1R5, 1R6, TL5, 
1 L6, as shown in Fig. 70, are displayed on the planes 
1R1* 1 LI and planes 1 R2 S 2L2 so that they overlap each 
Other as seen from one point on the line connecting tine 
left and right eyes of the observer 41 00. 

40 [04*5] This can be achieved by putting the centers or 
gravity centers of the two<limensional images 1R5, 
1R6, 1L5, 1L6 on the line of sight. 

[E-0016] 

45 

[0446] The important point of this embodiment is that, 
in the apparatus having the above-described configura- 
tion, the brightness of each of the two-dimensional im- 
ages 1R5, 1R6, 1L5, 1L6 is changed within the after im- 

50 age time of the human eye according to the depth posi- 
tion of the three-dimensional object 4104 (see Fig. 65) 
while keeping constant the overall brightness as seen 
by the observer 41 00 {Le. t in such a way that the overall 
brightness as seen by the observer 4100 is equal to the 

55 brightness of the three-dimensional object 4104. 
[0447] One example method of changing the bright- 
ness is described below. 

[0448] Figs. 72 to 75 show the configuration for only 



30 



EPO 959 377 



60 



the right eye because the same configuration applies 
also to the laft eye. Because Figs. 72 to 75 are black 
and white illustrations, parts with higher brightness lev- 
els are shaded darker for simplicity. 
[0449] When, for example, the three-dimensional ob- 
ject 4104 is displayed at a depth position corresponding 
to the positions of the planes 1 R1 , 1 LI , the brightness 
levels of the two-dimensional images 1RS, 1 L5 on the 
planes 1 R1, 1 L1 are set equal to the brightness level of 
the three-dimensional object 4104 and the brightness 
levels of the two-dimensional images 1 RG, 1 L6 on the 
planes 1R2, 1L2 are set to zero, as shown in Fig. 72. 
[0450] N ext, when the th ree-dimensional object 4104 
moves slightly away from the observer 41 00 and is dis- 
played at a depth position slightly away from the planes 
1 Rl., 1 L1 and closer to the planes 1 R2, 1 12, the bright- 
ness levels of the two-dimensional images 1R5, 1 L5 are 
slightly lowered and the brightness levels of the two-di- 
mensional images 1f36, 1L6 are slightly raised, as 
shown in Fig. 73. 

[04S1J Next, when the three-dimensional object 41 04 
moves further away from the observer 41 00 and is dis- 
played at a depth position further away from the planes 
1R1, 1L1 and closer to the planes 1R2, 1L2, the bright- 
ness levels of the two-dimensional images 1R5, 1L5are 
further lowered and the brightness levels of the two-di- 
mensional images 1R6, 1L6 are further raised, as 
shown in Fig. 74. 

[0452] Finally, when the three-dimensional object 
4104 is displayed at a depth position corresponding to 
the planes 1 R2, 1L2, the brightness ieveis of the two- 
dimensional images IBS, 1L6 on the planes 1R2, 1L2 
are set equal to the brightness level of the three-dimen- 
sional object 41 04 and the brightness levels of the two- 
dimensional images IRS, 1L5 on the planes 1R1, 1L1 
are set to zero, as shown in Fig, 75. 
[0453] Displaying the object in this manner enables 
the observer 41 00 to feel as if the three-dimensional ob- 
ject 4104 is located between the planes 1 R1 , 1 L1 and 
the planes 1.R2, 1 L2 because of human physiological or 
mental factors or optical illusion although what is actu- 
ally shown to the observer is the two-dimensional Imag- 
es 1R5, 1R6,1LS I 1LB. 

[0454] That is, when for example the two-dimensional 
images with almost equal brightness are displayed on 
the planes 1 Rl , 1 L1 and the planes 1 R2, 1 L2, the three- 
dimensional object 4104 looks as if it lies near to a mid- 
die point between the depth positions of the planes TR1 , 
111 and the planes 1R2, 112, 
[0455] Particularly when a point between the left and 
right eyes is usedasa viewing point on a line connecting 
the left and right eyes of the observer 41 00, the reliability 
for producing this effect is increased (or simpEy put, this 
same effect can be produced fora large number of peo- 
ple or most of the time). 

[0456] Further, when a center position between the 
left and right eyes of the observer 4100 is used as the 
viewing pointthere is an advantage that the same effect 



can be more readily produced and that the size of double 
image produced from the planes 1 Rl , 1 LI and planes 
1 R2, 1 R2 for both eyes can be reduced. 

5 1E-0017] 

[OAST] As with the nineteenth embodiment, this em- 
bodiment can obviously express the depth of a three- 
dimensional object itseff . 

to [0458] Unlike the conventional apparatus, this em- 
bodiment has at least two image display planes on the 
near and far sides of the optical illusion position, so that 
contradictions among the binocular parallax, conver- 
gence and focusing - the problem experienced with the 

is conventional apparatus -- can be suppressed signifi- 
cantly, which in turn is expected to reduce eyestrains. 
[0459] As to the focusing, because the observer 41 00 
sees two or more planes simultaneously the focus point 
coincides with the optical illusion position where both of 

20 the images can be seen with minimum blur. 

[0460) In this embodiment, because the displays are 
mounted one for each eye, there is an advantage that 
the two-dimensional images cart be readily displayed 
according to the movement of the observer or eyes. 

25 [0461 ] Further, because this embodiment makes use 
of human physiological or mental factors or optical illu- 
sion based only on brightness changes of twondimen- 
sional images, the embodiment does not require the use 
of a coherent light source such as a laser and facilitates 

so .the color stereoscopic image representation. 

[04621 Further, since this embodiment does not in- 
clude mechanical driving parts, it can suitably reduce 
the weight of and improve the reliability of the apparatus. 
IQ4633 This embodiment mainly concerns a case 

36 where there are only two planes for displaying two-di- 
mensional images and where a three-dimensional ob- 
ject 41 04 to be presented to the observer 4100 lies be- 
tween the two planes, it is, however, apparent that -the 
similar configuration can be employed if there are more 

40 planes or the three-dimensional object 41 04 to be pre- 
sented is iocated at a different position, 
[0464] Like the nineteenth embodiment, this embodi- 
ment can obviously display a video so that an observer 
can see the motion of an object in the horizontal and 

45 vertical directions as long as the two-dimensional dis* 
plays have display speeds compatible with the video, it 
is also apparent that the motion of an object in the depth 
direction can also be presented to the observer by 
changing the brightness of a plurality of planes for each 

so frame. 

[0465] It is obvious that, because of the after image 
effect, the above-described effect of this embodiment 
can be produced as long as the two<Jimensional images 
are displayed within one frame, whether they are dis- 
ss played simultaneously or at different times, or displayed 
simultaneously for one duration and separately for an- 
other duration, 

[0466] Further, this embodiment has an advantage of 
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being able to significantly reduce the amount oi data re- 
quired for three-dimensional representation because 
this embodiment can display a stereoscopic represen- 
tation of a three-dimensional object lying.between a plu- 
rality of planes. 

[Embodiment 21] 

[0467] An optical system 4103 that can be used in the 
preceding embodiments will be described. 
[0468] Fig. 76 shows one example of the optical sys* 
tern 41.03 that can be used In the preceding embodi- 
ments of the present invention. 
[0469] The optical system 4103 shown In Fig. 76 em- 
ploys a plurality of two-dimensional displays 4201, 
4202, a total reflecting mirror 4203 (for example, reflec- 
tivity/transmlttivity - 100/0), and a partial reflecting mir- 
ror 4204 (for example, reflectivity/transmittivlty = 50/50), 
[0470] The plurality of two-dimensional displays 
4201 , 4202 are, for example, CRT, liquid crystal display* 
LED display, plasma display, FED display, DMD display, 
projection type display and line drawing type display. 
[0471] In the optical system shown In Fig. 76, by 
changing the arrangement of the constitutional ele- 
ments, it is possible to place two planes 4205, 4206 at 
different positions in the direction of depth, the plane 
4205 being formed by reflecting a two-dimensional im- 
age of the two-dimensional display 4201 by the total re^ 
flecting mirror 4203 and passing jt through the partial 
reflecting mirror 4204, the plane 4206 being formed by 
reflecting a two-dimensional image of the two-dimen- 
sional display 4202 by the partial reflecting mirror 4204. 
[0472] in theoptical systemshown in Fig. 76, onjy mir- 
rors (total reflecting mirror 4203 and partial reflecting 
mirror 4204) are used, there is an advantage of less deg- 
radation of image quality. 

[E-0018] 

[0473] Fig. 77 illustrates another example of optical 
system 41 03 that can be used in the preceding embod- 
iments of the invention. 

[0474] The optical system 4103 shown in Fig. 77, by 
including lenses 4207, 4208 in the optical systemshown 
in Fig. 76, makes it possible to change the position of 
the planes more flexibly, 

[0475] In the optical system shown in Fig, 77, which 
includes a plurality ol two-dimensional displays 4201, 
4202, a total reflecting mirror 4203 (for example, reflec- 
tivity/transmittivlty = 100/0), and a partial reflecting mir- 
ror 4204 (for example, ref lectivjty/transmiuivtty .= 50750), 
convex lenses 4207, 4203 are added to change the po- 
sitions of the Images, thus allowing more flexible setting 
of the positional relation between the plane 4205 and 
the plane 4206 which has been restricted by the size of 
the apparatus. 

[0476] As in the ordinary lens system, it may of course 
be advantageous in terms of distortion to use a combi- 



nation lens in addition to convex lenses. 
.[0477] Further, although this embodiment has shown 
a case where virtual images are used, it is obvious that 
the invention can also be applied to a ease where real 
5 images are used, 

IE-00191 

[0476] Fig. 78 shows a further example of optical sys- 
f:0 tern 4103 that can be used in the preceding embody 
ments of the invention, 

[0479] The optical system 4103 shown in Fig. 78 in- 
corporates additional two-dimensional displays into the 
optical system shown tn Fig. 76. 

is [0480] That is, a plurality of two-dimensional displays 
4211, 4212, 4213, 4214, 4215, a total reflecting mirror 
4216 (e.g., reflect iv ity/transm ittf v ity = 10G/Q) and partial 
reflecting mirrors 4217 (e.g., reflectivity/transmiitivity = 
50/50), 4218(e.g. J reflectivity/transmittivity=33.3/66.7) J 

so 421 9 {e.g., ref lectivity/tmnsmittivity =25/75), 4220 {e.g., 
reflectivity/lransmittivity ~ 20/80) are used to construct 
an optical system, 

[0481] In the optical system 41 03 shown in Fig. 78, by 
changing the arrangements of these constitutional com- 

2£ poneots, it is possible to place a plane 422 1 and planes 
4222-4225 at different positions in the direction of depth, 
the image plane 4221 being formed by ref lecting a two- 
dimensional image of the two-dimensional display 421 1 
by the total reflecting mirror 4216 and passing it through 

so the partial reflecting mirrors 4217-4220, the planes 
4222-4225 being formed by reflecting two-dimensional 
images d the two-dimensional displays 421 2-421 5 by 
the partial reflecting mirrors 4217-4220 and passing 
them through these partial reflecting mirrors, 

$s [0482] This optical system 41 03 shown in Fig. 78 uses 
only mirrors and thus has the advantage of less degra- 
dation of picture quality. 

[0483] While Fig. 78 shows a case where there are 
fwetwo-dimensional displays, it isapparentthatthesim- 
40 jiar confjguratior) can be adopted when a different 
number of two-dimensional displays are used. 
[0484] In this case also, it is obvious that adding lens 
systems as shown in Figs. 77 makes it easy to control 
the positions of planes. 

45 

[E'0Q20] 

[0485] Fig. 79 shows a f urther example ol the optical 
system 41 03that can be used in the preceding embod- 

£0 Iments of the invention, 

[04$6] The optical system 41 03 shown in Fig. 79 uses 
a plurality of projector type two-dimensional displays 
4231, 423$, 4233, 4234, 4235, shutters 4241, 4.24.2, 
4243, 4244, 4245, and scatter plates 4236, 4237, 4238, 

£5 4239, 4240 to project two-dimensional images from the 
projector type two-dimensional displays 4231-4235 
through the shutters 4236-440 onto the scatter plates 
4236-4240 to produce the two-dimensional Images at 
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desired locations. 

[0487] The projector type two-dimensional displays 
4231-4235 are, for example, of CTR type, LCD type, !LV 
type, DMD type, etc. 

[0488] The scatter plates 4236-4240 are, for example, 
such devices as can control scattering/transmission or 
reflection/transmission, such as polymer dispersed liq- 
uid crystal devices, holographic polymer dispersed liq- 
uid crystal devices or combined devices of liquid crystal 
and multi-tens array. Shutters 4241-4245 may be such 
devices as can control transmission/interruption, such 
as twisted nematic liquid crystal devices, ferroelectric 
liquid crystal devices or mechanical shutter devices, 
[0489] The scatterplates 4236-4240 are arranged at 
different depth positions, the focusing planes of the pro- 
jector type twcKJimensional displays 4231-4235 are 
.aligned with these scatter plates 4236-4240, two-dimen* 
sional images are projected onto the scatter plates, and 
the scattering/transmission timing of the scatter plates 
4236-4240 is synchronized with the transmission/inter- 
ruption timing of the shutters 4241 -424.5 when activating 
the scatter plates and the shutters. This enables the 
depth positions of the planes 4241 -4245 formed on the 
scatter piates 4236-4240 to be controlled on a time di- 
vision basis. 

[0490] Like the optical system 4103 shown in Fig. 79, 
the use of projector type two-dimensional displays 
4231 -4235 provides an advantage of enhanced level of 
f reedom of display layout. 

[0491] Although the optica! system 4103 of Fig. 79 
concerns a case where there are five projector type two- 
dimensional displays, it is apparent that the similar con- 
figuration can be employed when a different number of 
displays are provided. 

[0492] it is obvious that the (amps of projector type 
two-dimensional displays 4231 -4235 can be turned on 
or off instead of using the shutters. 

[£-0021 J 

[0493] In the preceding embodiments, we have main- 
ly described a case where the planes are located near, 
inside or beyond the head-mounted displays. Incorpo- 
ration of optical devices enables these planes to be eas- 
ily arranged away from or in front of the two-dimensional 
displays. 

[0494] One such example is shown in Fig. 80. 
[0495] For example it can easily be seen that by ar- 
ranging a lens system 4303 in front of the optical system 
4301 shown in the preceding embodiments, the internal 
planes 4302 can be moved to the positions of external 
planes 4304, 

[0493] This offers the advantage that because the 
three-dimensional images are reproduced floating In 
space, the three-dimensional images are more likely to 
appear three-dimensional to the observer than when the 
three-dimensional images are located inside or behind 
the display. 



[0497] The invention has been described in detail in 
conjunction with the preceding embodiments and it 
should be noted that the invention is not limited to these 
embodiments and that various modifications may be 
5 made without departing from the spirit of the Envention. 

[E-0022] 

[0498] The representative advjantages of this inven- 
tion may be briefly summarised as follows. 
[0499] Contradictions among physiological factors 
associated with stereoscopy can be minimized; the 
amount of information required can be reduced; and 
electrically rewritable three-dimensional videos can fee 
reproduced, 

[Ft0001] 

[Embodiment 22] 

[0500] Figs, 81Aand81Bshpwtheconceptofatwen- 
ty-second embodiment of the invention. 
[GS01] Rg.8lAiilustratesathreg-dimensipnaldispiay 
5101 which allows a plurality of observers 5102, 5103, 
51 04 to simultaneously view a three-dimensional image 
displayed on the three-dimensional display 5101, by 
putting reflectors 5105, 5106, 5107 at different angles 
on the optical axis of the three-dimensional display to 
reflect the three-dimensional image toward the observ- 
ers. The reflectors 5 1 05, 5105, 51 07 used are, for ex- 
ample, half mirrors or prisms, which can perform reflec- 
tion or refraction and trahsmission : at the same time. The 
reflector 51 07 alone may use a total reflecting mirror. 
[0502] Fig.eiBillustratesathree-dimensionaldisplay 
5111 which allows a plurality of observers 5112, 511 3, 
51 14 to simultaneously view a three-dimensional image 
displayed on the three-dimensional display 5111, by 
putting reflectors 5115, 5116, 5117 at different angles 
on the optical axis of the three-dimensional display to 
reflect the three-dimensional image toward the observ- 
ers. Optical systems 5118, 6119, 5120 arranged on op- 
tical axes connecting the observers and the reflectors 
cause the three-dimensional image displayed on the 
three-dimensional display 5111 to be focused on an im- 
age plane 5121 so that ail the observers can view the 
three-dimensional image at the same position (image 
plane5121). The reflectors 5115, 6 11 S, 5117 used arc, 
for example, half mirrors or prisms, which can perform 
reflection or refraction and transmission at the same 
time. The reflector 51 1 7 alone may use a total reflecting 
mirror. 

[0503] With this simple method, a three-dimensional 
display that allows a plurality of observers to view ah 
image simultaneously can be realized. 

[Embodiment 23] 

[QS04] Figs. 82A and 82B Illustrate the concept of a 
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Iwisnty thlrd embodiment of the invention. 
10505] Fig, 82A illustrates a three-dimensional dis- 
play, which d isplays a three-dimensional image by using 
two displays 520 1 and 5202 and which Includes reflec- 
tors 5206, 5207, 520Band reflectors 6209, 5210, 5211 
arranged at different angles on two optical axes of the 
two displays to reflect two images of the two displays 
along the same optica) axis toward each of a plurality of 
observers 5203, 5204, 5205 so that each observer can 
view the two images overlapping each other and all the 
observers can view the same overlapping images at the 
same time. The reflectors 5206, 5207, .5208, 5209, 
5210, 5211 are, for example, half mirrors or prisms, 
which can perform reflection or refraction and transmis- 
sion at the same time. The reflector 6208 alone may use 
a total reflecting mirror. 

[0506] Fig, S2B illustrates a three-dimensional did" 
piay, which displays a three-dimensional image by using 
two displays 5221 and 5222 and which includes reflec- 
tors 5226, 5227, 522B and reflectors 5229, 5230, 5231 
arranged at different angles on two optical axes of the 
two displays to reflect two images of the two displays 
along the same optical axis toward each of a plurality of 
observers 5223, 5224, 5225 so that each observer can 
view the two images overlapping each other and all the 
observers can view the same overlapping images at the 
same time. Optical systems 5232, 5233, 5234 arranged 
on optical axes connecting the observers and the reflec- 
tors cause a three-dimensional Image displayed by the 
two displays 5221, 5222 to be focused on an image 
plane 5235 so that all the observers can view the three- 
dimensional image at the same position (image plane 
S235). The reflectors 5226, 5227, 5223, 5229, 5230, 
5231 are, for example, half mirrors or prisms, which can 
perform reflection or refraction and transmission at the 
same time. The reflector 5228 alone may use a total re- 
flecting mirror 

[0507] With this simple method, a three-dimensional 
display that allows a plurality of observers to view an 
image simultaneously can be realized. 

[Embodiment 24] 

[0506] Figs, 33A and 838 illustrate the concept of a 
twenty-fourth embodiment of the invention. 
[0509] Fig, S3A shows a three-dimensional display 
5301, which Includes reflectors 5305, 5306, 5307 ar- 
ranged at different angles on an optical axis of the three- 
dimensional display to reflect a three-dimensional im- 
age toward each of a plurality of observers 5302, 5303, 
5304 so that all the observers can viewthe three-dimen- 
sional image simultaneously. The reflectors 5305, 5306, 
.5307 may use, for example, diphfoic mirror, dichroic 
prism and holographic optical element, which can limit 
the wavelength to be reflected and can perform reflec- 
tion and transmission at the same time. The reflector 
5307 alone can use a total reflecting mirror. By shifting 
the reflection wavelength of each reflector to a degree 



that will not result in a significant change in color, all the 
observers can view almost the same.three<!imensional 
image. Color representation can be provided by stack- 
ing reflectors of three primary colors (R, G, 8) [for sx- 
5 ample, stacking three red, green and blue reflectors at 
the position of reflector 5305), 
[0510] Fig, 838 illustrates a three-dimensional dis- 
play, which displays a three-dimensional image by using 
two displays 5311 and 5312 and which includes reflec- 
ts tors 531 6, 531 7, 531 B and reflectors 5319, 5320, ,5321 
arranged at different angJes on two optical axes of the 
two displays to reflect two images of the two displays 
along the same optical axis toward each of a plurality of 
observers 5313, 5314, 531 5 so that each observer can 
15 view the two images overlapping each other and ail the 
observers can view a three-dimensional Image at the 
same time. The reflectors 531 6, 5317, 5318, 5319= 
5320, 5321 may use, for example, dichroic mirror, dich- 
roic .prism and holographic optical element, which can 
zo limit the wavelength to be reflected and can perform re- 
flection and transmission at the same time. The reflector 
5318 alone can use a total reflecting mirror. By shifting 
the reflection wavelength of each reflector to a degree 
that will not result in a significant change in color, all the 
£5 observers can view almost the same three-dimensional 
image. Color representation can be provided by stack- 
ing reflectors of three primary colors {B, G, 8) {for ex- 
ample, stacking three red, green and blue reflectors at 
the position of reflector 53 16). The paired reflectors {e, 
30 g., reflector 5316 and reflector 5319) may have the 
same band of wavelength. 

[0511] This configuration is possible even when mir- 
rors are overlapping each other on an optical axis, 

3* [Embodiment 25] 

[0512] Fig. 84A and 848 show the concept of a twen- 
ty-fifth embodiment of the invention. 
[0S13] Fig. 84A shows a three-dimensional display, 

40 which includes a viewing zone distributor 5407 to dis- 
tribute an optical axis from the three-dimensional dis- 
play 5401 into a plural ity of optical axes and refract tight 
from the three-dimensional display towardeach of a ply 
rality of observers 5402, 5403, 5404, 5405, 5406 so that 

45 all the observers can simultaneously view the same 
three-dimensional image display ed on the three-dimen- 
sional display. Among example devices used for the 
viewing zone distributor 5407 are a holographic optical 
element that has a plu rality of diffraction angles and can 

so diffract rays of iight at different angles at the same time, 
a prism array 5421 such as shown in Fig. 84C, and a 
diffraction grating array 5441 such as shown in Fig. 84E. 
The prism array 5421 has a number of small prisms 
5422 with different refraction directions to refract and 

5£ distribute light from the three-dimensional display to- 
ward each of the observers. Likewise, the diffraction 
grating array 5441 has a number of small diffraction 
gratings 5442 with different sizes of gratings to diffract 
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and distribute light from the three^jimensional display 
toward each of the observer, 
[0514] Fig. 94B shows a three-dimensional display, 
which includes a viewing zone distributor 541 7 to dis- 
tribute an optical axis Iron ihe three-dimensional dis- 
play $411 into a plurality of optica! axes and reflect light 
from the three-dimensional display toward each of a plu- 
rality of observers 541 2, 5413, 5414, 5415, 541 6 so that 
alt the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional display. Among example devices used for the 
viewing zone distributor 5417 are a holographic optical 
element that has a plurality of reflection angles and can 
reflect rays of light at different angles at ihe same time, 
a mirror array 5431 such as shown in Fig. B4D, and a 
diffraction grating array 544 1 such as shown In Fig. 84E. 
The mirror array 5431 has a number of small mirrors 
5432 with different reflection directions to reflect light 
from the three-dimensional display toward each ol the 
observers. Likewise, the diffraction grating array 5441 
has a number of small diffraction gratings 5442 with dif- 
ferent sizes of .gratings to reflect and distribute lightfrom 
the thnee-dirnensional display toward each of the ob^ 
server 

[0515] This arrangement can expand a viewing zone 
of an observer while moving or a viewing zone for a plu- 
rality of observers, 

[Embodiment 26] 

[051 6] Figs. 85A and 85B show th e concept of a twen- 
ty-sixth embodiment of the invention. 
[051 7] Fig. 85A shows a three-dimensional display, 
which includes a viewing zone distributor .5.507 to dis- 
tribute an optical axis from the three-dimensional dis- 
play 5501 into a plurality of optical axes and refract light 
from the three-dimensional display toward each of a plu- 
rality of observers 5502, 5503, 5504, 5505, 5506 so that 
all the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional dlspiay. The viewing zone distributor 5507 uses 
a plurality of holographic optical elements stacked to- 
gether each of which can diffract light at only one angle. 
The holographic optical elements 5508, 5509, 5510, 
551 1 , 551 2 with different diffraction angles are stacked 
together to diffract light from the three-dimensional dis- 
play toward the respective observers, 
[0516] Fig. 85B shows a three-dimensional display, 
which includes a viewing zone distributor 5527 to dis- 
tribute an optica* axis from the three-dimensional dis- 
play 5521 into a plurality of optical axes and reflect light 
from the three-dimensional display toward each of a plu- 
rality of observers 5522, 5523, 5524, 5525, 5526 so that 
all the observers can simultaneously view the same 
three-dimensional image displayed on the three-dimen- 
sional display The viewing zone distributor 5527 uses 
a plurality of holographic optical elements stacked to- 
gether each of which can diffract light at only one angle, 



The holographic optical elements 5528, 5529, 5530, 
5531, 5532 with different reflection angles are stacked 
together to distribute light from the three-dimensional 
display toward the respective observers. 
5 [0519] This arrangement can expand a viewing zone 
of an observer while moving or a viewing zone for a plu- 
rality of observers. 

{Embodiment 27] 

10 

[0520] Figs. 86A to 86D show the concept of a twenty- 
seventh embodiment of the invention. 
[0521] Fig. 86A illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 5607 to 

ts distribute an optical axis from the three-dimensional dis- 
play 5601 into a plurality of optical axes on a time divi- 
sion basis and refract light from the three-dimensional 
display toward each of a plurality of observers 5602, 
5603, 5604, 5605, 5606 so that all the observers can 

20 view the same three-dimensional image. The viewing 
zone distributor 5607 uses a liquid crystal deflection el- 
ement which comprises a liquid crystal and an optical 
element disposed in contact with the liquid crystal, The 
liquid crystal deflection element deflects light from the 

25 three-dimensional display at high speed within the after 
image time of human eye between observer 5602 and 
observer 5606 to distribute light to individual observers. 
When the light, while being deflected, reaches the di- 
rection of an observer, it is halted temporarily at that po- 

30 sftion and then deflected toward the next observer. This 
process is repeated at high speed allowing the observ- 
ers to see a three-dimensional image. 
[0522] Fig. 86B illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 561 7 and 

3s a reflector 5618 to distribute an optical axis from the 
three-dimensional display 5611 into a plurality of optical 
axes on a time division basis and reflect light from the 
three-dimensional display toward each of a plurality of 
observers 5612, 5613, 5614, 5615, 5616 so that all the 

to observers can view the same three-dimensional image. 
The viewing zone distributor 561 7 uses a liquid crystal 
deflection element which comprises a liquid crystal and 
an optical element disposed in contact with the liquid 
crystal. The liquid crystal deflection element deflects 

45 light from the three-dimensional display at high speed 
within the after image lime of human eye between ob- 
server 5612 and observer 5616 to distribute light to in- 
dividual observers- When the light, while being deflect- 
ed, reaches the direction of an observer, it is halted tem- 

50 porarily at that position and then deflected toward the 
next observer, this process is repeated at high speed 
allowing the observers to see a three-dimensional im- 
age. The reflector 5618 uses such reflecting material as 
mirror. 

55 [0523] Fig. 86C illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 5627 to 
distribute an optical axis from the three-dimensional dis- 
play 5621 info a plurality of optical axes on a time divi- 
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sion basis and refract light from the three-dimensional 
display toward each of a plurality of observers 5622, 
5623, 5624, 5625, 5626 so that all the observers can 
view the same three-dimensional image. The viewing 
zone distributor 5627 uses a liquid crystal deflection el- 
ement which comprises a liquid crystal and an optical 
element disposed in contact with the liquid crystal, The 
liquid crystal deflection element deflects light from the 
three-dimensional display at high speed within the after 
image time of human eye between observer 5622 and 
observer 5626 to distribute light to Individual observers, 
A shutter 5628 is operated at the same time that the re- 
fraction direction of the viewing zone distributor 5627 
aligns with the direction of each observer, thus allowing 
the observers to see a three-dimensional image. 
[0524] Fig. 86D illustrates a three-dimensional dis- 
play, which includes a viewing zone distributor 5637 and 
a reflector 5638 to distribute an optical axis from the 
three-dimensional display 5631 into a plurality of optical 
axes on a time division basis and reflect light from the 
three-dimensional dispfay toward each of a plurality of 
observers 6632, 6633, 5634, 5635, 5636 so that all the 
observers can view the same three-dimensional image. 
The viewing zone distributor 5637 uses a liquid crystal 
deflection element which comprises a liquid crystal and 
an optical element disposed in contact with the liquid 
crystal. The liquid crystal deflection element deflects 
light from the three-dimensional display at high speed 
within the after image time of human eye between ob- 
server 5632 and observer 5636 to distribute light to in- 
dividual observers. A shutter 5639 is operated at the 
same time that the refraction direction of the viewing 
zone distributor 5637 aligns with the direction of each 
observer, thus allowing the observers to see a three-di- 
mensional image. The reflector 5638 uses such reflect- 
ing material as mirror. 

[0525] This apparatus can aiso be used for expanding 
a viewing zone of an observer when he or she moves. 

[Embodiment 28] 

[0526] Figs. 87Aand 87Bshow the concept of a twen- 
ty-eighth embodiment of the invention, 
[0527] Fig. 87A illustrates a three-dimensional dis- 
play, which includes a reflector 5707 to distribute an op- 
tical axis from the three-dimensional display 5701 into 
a plurality of optical axes on a time division basis and 
reflect/refract light from the three-dimensional display 
toward each of a plurality of observers 5702, 5703, 
5704, 5705, 5706 so that all the observers can view the 
same three-dimensional image. Among devices used 
for the reflector 5707 are a half mirror, a total reflecting 
mirror and.a prism, The refl ector.5707 deflects light f rom 
the three-dimensional display at high speed within the 
after image time of human eye between observer 5702 
and observer 5706 to distribute light to individual ob- 
servers. Light distribution can be achieved by recipro- 
cating the reflector to left and right at high speed or by 



rotating it in one direction. When the light, while being 
deflected, reaches the direction of an observer, it is 
stopped temporarily at that position and then deflected 
toward the next observer. This process is repeated at 
§ high speed allowingtheobserverstosee athree-dimen- 
sional image. 

[0528] Fig. 87B illustrates a three-dimensional dis^ 
play, which includes a reflector 5717 to distribute an op- 
tical axis from the three-dimensional display 571 1 into 

io a plurality of optical axes on a time division basis and 
reflect/refract light from the three-dimensjonal display 
toward each of a plurality of observers 6712, 5713, 
5714, 5715, 571 6 so that all the observers can view the 
same thrae^imanslpnal image. Among devices used 

ts for the reflector 5717 are a half mirror, a total reflecting 
mirrorandaprism. The reflector 57 17 deflects light from 
the three-dimensional display at high speed within the 
after image time of human eye between observer 5712 
and observer 5716 to distribute light to Individual ofr 

'90 servers. Light distribution can be achieved by recipro- 
cating the reflector to left and right at high : speed or by 
rotating it in one direction. A shutter 5718 is operated at 
the same time that the reflection/refraction direction of 
light, while being deflected, aligns with the direction of 
each observer, thus allowing the observers to see a 
three-dimensional image. 

[0529] This arrangement can expand a viewing zone 
of an observer While moving or a viewing zone for a plu- 
rality of observers. 

so [O530J The present invention has been described in 
detail in conjunction with example embodiments. It 
should be noted that the invention can be applied not 
only to the above-described three-dimensional displays 
but also as a means to expand a narrow viewing zone 

35 jn general three-dimensional displays or stereoscopic 
displays. It should also be noted that the invention is not 
limited to these embodiments but various modifications 
may be made without departing from the spirit of the in- 
vention. 

40 [0531] The representative advantages of this inven- 
tion may be briefly summarized as follows. 
[0532] In three-dimensional displays or stereoscopic 
displays with narrow viewing zones, the viewing zone 
distributor installed to distribute a viewing zone from the 

4s display toa plurality of other directions allows expansion 
of the viewing zone or increase In the number of viewing 
zones, which in turn makes it possible for a plural ity of 
people to simultaneously view the displayed image or 
for a moving observers view the image. 

50 [0533] In a three-dimensional display which gener- 
ates a three-dimensional image by displaying on a plu- 
rality of image planes at different depth positions two- 
dimensional images with brightness levels whose ratio 
corresponds to the depth position of each part of an oh- 

55 Ject to be presented, the viewing zone distributor in* 
stalled to distribute the viewing zone from the display 
Into a plurality of other directions allows expansion of 
the viewing zone while keeping the misalignment be- 
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tween the front and rear displayed images at a low level 
that does not appear incongruous to the observer. The 
provision of the viewing zone distributor also allows the 
three-dimensional image to be viewed by a plurality of 
observers simultaneously or to be seen by the observer 
while moving, 

[F-0002] 

[Center of Overlapping Two-Dimensicna! Images] 

10534] In the preceding embodiments, the phenome- 
non of this invention occurs when the sizes of two-di- 
mensional images on the front and rear planes are con- 
trolled so that these two-dimensional images overlap as 
seen with the visual acuity of the observer from one point 
on a line connecting the left and right eyes of the ob- 
server. More precisely speaking, the essential require- 
ment for this phenomenon is that the two-dimensional 
images must overlap in the vertical direction as viewed 
with the visual acuity of the observer from one point on 
a line connecting the left and right eyes of the observer. 
[0535] This is explained by referring to Figs, 88A to 
88C. The best viewing position is at a middle point be- 
tween the left and right eyes, as shown in Fig. 88A. This 
is because the double image of edge portions as seen 
from both eyes are smallest in this case. The viewing 
position from which the phenomenon of the invention 
can be observed is between both eyes, and the extreme 
allowable position Is as shown in Fig. 8BB. There is a 
possibility, however, that this phenomenon can still be 
observed even when the viewing position goes outside 
both eyes by asmall amount undistinguishable from Fig, 
86B and stays within the visual acuity of the observer, 
as shown in Fig. 88C. When the viewing position moves 
further away, this phenomenon generally eannot.be ob- 
served correctly, with the displayed images perceived 
as two separate front and rear two-dimensional images- 

[Coloring of Overlapping Two-Dimensional Images] 

[0536] With this invention, the apparent depth position 
of a perceived three-dimensional image can be changed 
by changing the ratio of brightness levels of the front 
and rear two-dimensional images. Hence, as shown in 
Fig. 89, the color of the front two-dimensional image (e, 
g., red in Fig. 89) and the color of the rear two-dimen- 
sional image (e.g., green in Fig 89)can be differentiated 
from each other in such away that the three-dimension- 
al image that is perceived by the observer when he sees 
these overlapping two-dimensional Images has the in- 
tended color to be presented [e.g., yellow in Fig. 89). 

[Distance between Planes] 

[0537] The phenomenon of the present invention is 
prodyced when there are overlapping portions of the 
front and rear two-dimensional images in the right-eye 



image and In the left-eye image, as shown in Fig. 9QA 
Hence, when the front and rear planes are set apart by 
a great distance and the front and rear two-dimensional 
images do not overlap and . are separated in the right- 
5 eye image and in the left-eye image, as shown in Fig. 
SOB, the phenomenon of interest is not generated and 
the observer perceives two separate front and rear two- 
dimensional images. 

10 (F-Q0Q3] 

10533] Another example of the embodiment 28 is ex- 
plained by referring to Figs. 91 A and 918, Fig. :91 A II* 
lustrates an example case where a three-dimensional 
virtual image is produced. Fig. 91.6 illustrates an e.xam- 
pie case where a three-dimensional real image is gen- 
erated. This embodiment includes a two-dimensional 
display (for example, CRT, liquid crystal display, LED 
display, POP and FED), a yarilocal lens (for example, 
20 dual-frequency type: see Japanese Patent Application 
182222/1 996 titled "Optical Apparatus"; high-voltage 
liquid crystal type: see Japanese Patent Application 
202244/1.996 titled "Optica! Apparatus"; polarizing 
multifocal type; and liquid crystal motor type; see Japa- 
ns nese Patent Application 301600/1 997 titled "Optical Ap- 
paratus"), an optical system (tor example, concave lens, 
convex lens, concave mirror, convex mirror, total reflect- 
ing mirror, partial reflecting mirror, and prism). 
[0539] The varifocallens, a key device in this embod- 
30 iment, can change its focal length at high speed and 
therefore can focus a displayed image of the two-dimen- 
sional display at different depth positions. Therefore, by 
synchronizing a change in the focal length of the varifo- 
cal lens driven by a driving device with an image display 
$5 timingof the two-dimensional display by a synchronizing 
device and also by writing the images at all depth posi- 
tions within the after image time, it is possible to provide 
a th ree-dimensionai representation in a depth sampling 
manner 

40 [0540] The present invention has been described in 
detail with respect to preferred embodiments, and it will 
now be apparent frdm the foregoing to those skilled in 
the art that changes and modification may be made with- 
out departing from the invention in its broader aspect, 

4$ and it is the invention, therefore, in the apparent claims 
to cover all such changes and modification as fail within 
the true spirit of the invention. 



so Claims 

1. A three-dimensional representation method for 
generating a three-dimensional image by display- 
ing two-dimensional images on a plurality of image 
55 planes located at different depth positions, the 
method characterized by comprising the steps of: 

generating two-dimensional images in which 
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an object to be presented is projected along the 
line of sight of an observer onto a plurality of 
image planes located at different depth posi- 
tions as seen from the observer; and 
changing brightness levels of the generated 
two-dimensional images individually for each 
image plane to display the generated two-di- 
mensional images on the plurality of image 
planes. 

2. A three-dimensional representation method as 
claimed in claim 1 , characterized in that, when the 
object to be presented is displayed at a depth posi- 
tion close to the observer, the brightness levels o! 
the two-dimensional images displayed on those im- 
age planes ol tine plurality of image planes which 
are close to the observer are rased and the bright- 
ness levels of the two-dimensional images dis- 
played on ttie image planes remote from the ob- 
server are lowered, and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the brightness levels of the two- 
dimensional images displayed on those image 
planes of trie plurality of image planes which are 
close to the observer are lowered and the bright- 
ness levels of the two-dimensional images dis- 
played on the image planes remote from the ob- 
server are raised. 

3. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the two-di- 
mensional Images are displayed on the plurality of 
image planes in such a way that the two-dimension- 
al images overlap each other when the two-dimen- 
sional images are viewed from one point on a line 
which passes through the right and left eyes of an 
observer and that an overall brightness level as 
seen by the observer is equal to the brightness level 
of the original object to be presented. 

4. A three-dimensional representation method as 
claimed in claim 3, characterized in that the point 
on the line which passes through the right and left 
eyes of the observer is one point between the right 
and left eyes. 

5. A three-dimensional representation method as 
claimed in claim 3, characterized in that the point 
on the line which passes through the right and left 
eyes of the observer is the point of the center be- 
tween the right and left eyes. 

6. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the two-di- 
mensional images are arranged to overlap by view- 
ingfrom one pointon the line which passes through 
the right and left of the observer and thetwo-dimen- 



sional images are enlarged or reduced in the hori- 
zontal direction respectively, 

7. A three-dimensional representation method as 

5 claimed in claim 2, characterized in that the two-di- 
mensional images are displayed on the plurality of 
image planes in such a way that the two-dimension- 
al images overlap each other when the two-dimen- 
sional images are viewed from one point on the line 

io which passes through the right and left eyes of the 
observer and characterized In that when the depth 
position of the object to be presented is remote from 
the observer, an overaU brightness level as seen by 
the observer is set lower than the brightness level 

is of the original object whan the depth position of the 
object Is close, 

8. A three-dimensional representation method as 
claimed in claim 1 , characterized in that the two-di- 

2Q mensional images are switched successively to 
generate a three-dimensional moving image. 

% A three-dimensional representation method as 
claimed in claim 8, 

6 characterized in that when the two-dimen* 
sbnal images include a plurality ol images of an ob- 
ject moving in a direct ion of depth and the object is 
moving toward the observer, the brightness levels 
of the object images displayed on the plurality of im- 

so age planes are progressively raised toward an im- 
age plane close to the observer and progressively 
lowered toward an image plane remote from the ob- 
server in synchronism with the successive switch- 
ing of the two-dimensional images, and 

35 characterized in that when the two-dimen- 

sional images include a plurality of images ol an ob- 
ject moving in a direction of depth and the object is 
moving away from the observer, the brightness lev- 
els of the object images displayed on the plurality 

40 of image planes are progressively lowered toward 
an image plane close to the observer and progres- 
sively raised toward an image plane remote from 
the observer in synchronism with the successive 
switching of the two-dimensional images. 

45 

10. A three-dimensional representation method as 
claimed in claim 1 , characterized in that distances 
of depth between the image planes are wiihin a 
range havinga common area in the casethata plu- 

50 rality of two-dimensional images are viewed by a 
single eye of the observer at the position of the right 
and left eyes of the observer, the plurality of two- 
dimensional images being displayed on the image 
planes for the same object to be presented 

55 

11. A three-dimensional representation method as 
claimed in claim 1, characterized in that the colors 
of the plurality of two-dimensional objects to be pre- 
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sented In the two-dimensional images are different 
each other, the color of a three-dimensional object 
to be represent is determined according to the dif- 
ferent colors and the colors of the plurality of the 
two-dimensional objects is possible to change with- 
out changing the determined color which is viewed 
by the observer, 

12. A three-dimensional display characterized by com- 
prising: 

a first means for generating two-dimensional 
images in which an object to .be presented is 
projected along the line of sight of an observer, 
onto a plurality of image planes located at dif- 
ferent depth positions as seen from the observ- 
er; 

a second means for displaying the two-dimen- 
sional images generated by the first means on 
theplurality of image planes located atdiffereni 
depth positions as seen from the observer; and 
a third means for changing brightness levels of 
the two-dimensional images displayed on the 
plurality of image planes individually for each 
image plane. 

13, A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; and 
partial reflecting mirrors combined with the plu- 
rality of two-dimensional displays except for 
one two-dimensional display located at the re- 
motest depth position from the observer, the 
partial reflecting mirrors being adapted to lo- 
cate images of the two-dimensional displays on 
the line of sight of the observer. 

14 A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; and 
combinations of partial reflecting mirrors and 
lenses, the partial reflecting mirror and lens 
combinations being combined with the plu ralfty 
of two-dimensional displays except for one two- 
dimensional display located at the remotest 
depth position from the observer, the partial re- 
flecting mirror and lens combinations being 
adapted to locate images of the two-dimension- 
al displays on the line of sight of the observer, 

IS. Athree-dimensiona] displayas claimed in claim 12, 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mir- 
ror combined with one of the plurality of two- 



dimensional displays which is located at the re- 
motest depth position from the observer, the to- 
tal reflecting mirror or partial reflecting mirror 
being adapted to locate an image of the one 
-5 two-dimensional display on the line of sight of 

the observer; and 

partial reflecting mirrors combined with the two- 
dimensional displays except for the one two-di- 
mensional display located at the remotest 
iO depth position from the observer, the partial re- 

flecting mirrors being adapted to.locate images 
of the two-dimensional displays on the line of 
sight of the observers, 

1-5 16. A three-dimensional display as claimed in claim 1 Z 
characterized in that the second means comprises: 

a plurality of two-dimensional displays; 

a combination of a total reflecting mirror and a 

2Q lens or a combination of a partial reflecting mir- 

ror and a lens, the combination being combined 
with one of the plurality of two-dimensional dis- 
plays which is located at the remotest depth po- 
sition from the observer, the combination being 

25 adapted to locate an image of tile one two-di- 

mensional display on the line of sight of the ob- 
server; and 

combinations of partial reflecting mirrors and 
lenses, the combinations being combined with 

30 the two-dimensional displays except for one 

two-dimensional display located at the remot- 
est depth position from the observer, the com- 
binations being adapted to locate images of the 
two-dimensional displays on the line of sight of 

35 the observer. 

17. A three-dimensional display as claimed in claim 1 2, 
characterized in that the second means comprises: 

40 a plurality of scatter plates capable of control- 

ling a switching between a transmitting slate 
and a scattering state or a plurality of reflection 
plates capable of controlling the switching be- 
tween a reflecting state and a transmitting 

45 state, the scatter plates or reflection plates be- 

ing located at different depth positions as 
viewed from the observer; 
a plurality of projection type two-dimensional 
displays for projecting two-dimensional images 

so onto the plurality of scatter plates or the plurality 

of reflection plates; and 
a plurality of shutters disposed between the plu- 
rality of scatter pfotes or reflection plates and 
the plurality of projection type two-dimensional 

SB displays, the plurality of shutters being adapted 

to switch between a transmitting state and a 
cutoff state in synchronism with the switching 
between the transmitting state and the scatier- 
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ing state of the plurality of scatter plates or be- 
tween the reflecting state and the transmitting 
state of the plurality of reflection plates. 

18. A three-dimensional display as claimed in claim 1.2, 
characterized in that a lens optical system is dis- 
posed between the observer and the plurality of im- 
age planes located at different depth positions as 
seen from the observer. 

1 9. A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

a two-dimensional display; 
an optical system; and 
a varifocal mirror. 

20. A three-dimensional display as claimed in claim 1.2, 
characterized in that the second means comprises: 

a vibration screen which vibrates in the direc- 
tion of depth; 

an optical system including a lens; 

a scanning means for raster-scanning a laser 

beam; and 

a laser beam source. 

21 . A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

an LED display having an LED array; 
a parallel advancing/rotating device for paral- 
lelly advancing/rotating the LED display; and 
a video feeding device for feeding a video sig- 
nal to the LEO display. 

22. A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

a film having a two-dimensional image record" 
ed therein or two-dimensional display; 
an image transforming optical system having a 
prism or mirror; and 
a projection drum, 

23. A three-dimensional display as claimed in claim 12, 
characterized in that the second means comprises: 

a two-dimensional display; 
an optical system; 

a varifocal lens having a variable focal length; 
a driving device for driving the varifocal ions; 
and 

a synchronizing device for synchronizing a 
change in the focal length of the varifocal lens 
with the displaying of an image of the two-di- 
mensional display. 



24. A three-dimensional display as claimed in claim 12, 
characterized in that the second means succes- 
sively switches the two-dimensional images gener* 
ated by the firstmeans to generate a moving three- 

5 dimensional image. 

25. A three-dimensional display as claimed in claim 24, 

characterized in that when the two-dimen- 
sional images generated by the first means include 

io a plurality of images of an object moving in a direc- 
tion of depth and the object is moving toward the 
observer, the third means progressively raises the 
brightness levels of the object images displayed on 
the plurality of image planes toward an image plane 

i$ close to tho observer and progressively lowers the 
brightness levels of the object images toward an im- 
age plane remote from the observer in synchronism 
with the successive switching of thetwo-dimension- 
aj Images by the second means, and 

2Q characterized in that wh en the object is mov- 

ing away from the observer, the third rneans pro- 
gressively lowers the brightness levels of the object 
images displayed on the plurality of image planes 
toward an image plane close to tins observer and 

25 progressively raises the brightness levels of the ob- 
ject images toward an image plane remote from the 
observer in synchronism with the successive 
switching of the two-dimensional images by the 
second means. 

$Q 

26. A three-dimensional display as claimed in claim 12, 
characterized in that the colors of the plurality of 
two-dimensional objects to be presented in the two- 
dimensional images are different each other, the 

35 color of a three-dimensional object to be represent- 
ed is determined to the different colors and the 
colors of the plurality of the two-dimensional objects 
is possible to change without changing the deter- 
mined color which is viewed by the observer. 

40 

27. A three-dimensional representation method char- 
acterized by comprising the steps of: 



45 



50 



generating two-dimensional images by in which 
an object is projected along the line of sight of 
an observer, onto a plurality of image planes 
ilocated at different depth positions as seen 
from an observer; 

changing brightness levels of the generated 
two-dimensional images and displaying them 
on the respective image planes; and 
delecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 
tical directions to change the two-dimensional 
images displayed on respective displays ac- 
cording to the detected movement of the view- 
ing point, 
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28. A three-dimensional representation method as 
claimed in claim 27, characterized in that the dis- 
plays displaying the plurality of two-dimensional im- 
ages are parallelly moved according to the move- 
ment ol the viewing point of the observer. 

29. A three-dimensional representation method as 
daimedln claim 27 r characterized in that, according 
to the movement of the viewing point of the observ- 
er, the plurality of two-dimensional images are re- 
written into Images as they will appear when viewed 
from the direction of the observer. 

30. A three-dimensional representation method char- 
acterized by comprising the steps of : 



tical directions; 

a two-dimensional image transformation de- 
vice for changing the two-dimensional images 
according to the detected movement of the 
& viewing point; and 

displays for displaying the transformed two-di- 
mensional images. 

33. A three-dimensional display as claimed In claim 32, 
io characterized in that the two-dimensional image 
transformation device has one or. more of transfor- 
mation processing means for parallelly moving, en- 
larging and reducing the plurality of two-dimension- 
al images according to the movement of the viewing 
is point of the observer 



generating two-dimensional images In which 
an object is projected along the line of sight of 
an observer onto a plurality of image planes 
located at different depth positions as seen 
f rom an observer; 

distributing the generated two-dimensional im- 
ages to respective displays and changing 
brightness levels of the two-dimensional imag- 
es according to depth positions where the two- 
dimensional images are to be displayed, and 
displaying them on the respective image 
planes; and 

detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 
tical directions to change the two-dimensional 
images displayed on the respective displays 
according to the detected movement of the 
viewing point. 

31. A three-dimensional representation method as 
claimed in claim 27, characterized in that, according 
to the movement of the viewing point of the observ- 
er, the pi urality of two-dimensional images are sub- 
jected to one or more of transformation processing 
including parallel movement, enlargement and re- 
duction. 

32. A three<Jimensionai display characterized by com- 
prising: 

a two-dimensional Image generating device for 
generating two-dimensional images in which 
an object is projected along the line of sight of 
an observer, onto a plurality of image planes 
located at different positions as seen from the 
observer; 

a brightness level changing device forchanging 
brightness levels of the two-dimensional imag- 
es and displaying them on the image planes; 
a viewing point movement detecting device for 
detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 



34. A three-dimensional display as claimed in.claim 32, 
further including a means for parallelly moving the 
displays for displaying the plurality of two-dimen- 

*0 sional images according to the movement of the 
viewing point of the observer 

35. A th ree-dimensional display characterized by com- 
prising: 

25 

a two-dimensional image generating device for 
generating two-dimensionai Images in which 
an object is projected aiong the line of sight of 
an observer, onto a plurality of image planes 
so located at different positions as seen from the 

observer; 

a distribution device for distributing the gener- 
ated two-dimensional images to displays ac- 
cording to depth positions where the two-di- 
35 meneional images are to be displayed, the dis- 

plays corresponding to the respective depth po- 
sitions; 

a brightness level changing device for changing 
brightness levels of the two-dimensional imag- 
es qs and displaying them on the image planes; 

a viewing point movement detecting device for 
detecting the movement of a viewing point of 
the observer in longitudinal, horizontal and ver- 
tical directions; 
<*s a two-dimensional image transformation de- 

vice for changing the two-dimensional images 
according to the detected movement of the 
viewing point; and 

displays for displaying the transformed two-di- 
50 mensional images. 

36. Athree-dimensionat display as claimed in claim 32, 
characterized in that the viewing point movement 
detecting device comprises one or more of an infra- 

55 red sensor, an ultrasonic sensor, a laser distance 
sensor, an optical sensor, a camera image-based 
position detection, and a magnetic sensor. 
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37. A three-dimensional representation method which 
generates a three-dimensional image in which an 
object to be presented onto planes is projected 
along the line of sight of an observer, by displaying 
the two-dimensional images on a plurality of image 
planes simultaneously and at desired brightness 
levels, the plurality of image planes being located 
at different depth positions, the three-dimensional 
representation method characterized by compris- 
ing the steps of: 

selecting one of the plurality of objects when 
the object to.be presented comprises a plurality 
of objects having different depth positions; 
generating two-dimensional Images by in which 
the selected object is projected onto planes 
along the line of sight of the observer; 
displaying the generated two-dimensional Im- 
ages on the plurality of image planes simulta- 
neously; and 

repeating the above three steps for all of the 
pi u rallty of objects within an after image time of 
human eye to successively display three-di- 
mensional images of the plurality of objects on 
a time division basis within.theafier Image time 
of human eye. 

38. A three-dimensional representation method as 
claimed in claim 37, characterized in that when the 
two-dimensional images are displayed on the plu^ 
rallty of image planes simultaneously for a plurality 
of objects, the brightness levels of the two-dimen* 
sional Images displayed on the image planes are 
changed todesired brightness levels individually for 
each two-dimensional image, 

39. A three-dimensional representation method as 
claimed in claim 37, characterized in that the bright- 
ness levels of the plurality of image planes are 
changed periodically; in synchronism with the 
brightness levels of the image planes becoming de- 
sired levels, an object is selected from the piuralfty 
of objects of two-dimensional images to be dis- 
played at the desired brightness levels and the two- 
dimensional images of the selected object are dis- 
played on the plurality of image planes simultane- 
ously; and this process is performed successively 

40. A three-dimensional display characterized by com- 
prising: 

. a two-dimensional image generating means for 
generating two-dimensional images in which 
one object of a plurality of objects to be present- 
ed, the plurality of objects having different 
depth positions, is selected one by one and se- 
lected object is projected onto the planes along 
the line of sight of an observer; 



a display means for displaying the two-dimen- 
sional images generated by the two<liiwision- 
at image generating means simultaneously on 
a plurality of image planes for one selected o.b~ 

B ject after another, the image planes being lo- 

cated at different depth positions as seen from 
the observer, the display means being adapted 
to repetitively display all of the two-di mansions! 
images generated by the two-dimensional im- 

10 age generating means successively within an 

after image time of human eye; and 
a brightness level adjusting means for adj usting 
brightness levels of the two-dimensional imag- 
es displayed on the image planes of the display 

T5 means in synchronism with thedispiayingof the 

two-dimensional images on the image planes 
of the display means, 

41. A three-dimensional display as claimed in claim 40, 
so characterized in that the brightness level adjusting 
means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the brightness level adjusting means, 
the two-dimensional image generating means se- 
2S tects an object from the plurality of objects of two- 
dimensional images to be displayed at desired 
brightness levels, and generates the two-dimen- 
sional images of the selected object. 

3P 42. A three-dimensional display as claimed In claim 40, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional Images of the 

35 selected object, and the brightness leveladjusting 
means changes the brightness level In synchronism 
with the two-dimensional images being generated 
by the two-dimensional image generating means. 

& 43, A three-dimensional display characterized by com- 
prising: 

a two-dimensional image generating means for 
generating two-dimensional images m which 

4$ one object of a plurality of objects to be present- 

ed is selected one by one the plurality of objects 
having different depth positions, and the select- 
ed object is projected on to the planes along 
the line of sight of ah observer; and 

50 a display means for displaying the two-dimen- 

sional images generated by the two-dimension- 
al image generating means simultaneously on 
a plurality of image planes at predetermined 
brightness levels for one selected object after 

■ 5.5 another, the image planes being located at dif- 

ferent depth positions as seen from the observ- 
er, the display means being adapted to repeti- 
tively display ail of the two-dimensional images 
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generated by the two-dimensional image gen^ 
erating means successively within an alter im- 
age time of human eye; 
wherein the display means Includes: 
a two-dimensiona] display means located at 
each image plane to display two-dimensional 
images generated by the two-dimensional im- 
age generating means; and 
a brightness level adjusting means disposed in 
front of the two<iimensional display means. 

44, A three-dimensional display as claimed in claim 43, 
characterized in that the brightness ievel adjusting 
means changes the brightness level periodically 
and, In synchronism with the brightness level being 
changed by the brightness level adjusting means, 
the two-dimensional image generating means se- 
lects an object from the plurality of objects to be pre- 
sented at desired brightness level, and generates 
the two-dimensional images fortheselecied objecl 

45, A three-dimensional display as claimed in claim 43, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images for the 
selected object, and the brightness level adjusting 
means changes the brightness level in synchronism 
with the two-dimensional images being generated 
by the two-dimensional image generating means. 

46, A three-dimensional display as claimed in claim 43, 
characterized in that the brightness level adjusting 
means is a beam attenuating filter 

47, A three-dimensional display as claimed in claim 46, 
characterized in that the beam attenuating filter is 
either a rotary filter which continuously changes 
light intensity attenuation, a filter that rotates a plu- 
rality of slits, a filter that changes an interruption/ 
transmission time by a shutter or a filter that chang- 
es.a number of times of interruptionsAransmissions 
by a shutter. 

46. A three-dimensional display as claimed in claim 43, 
characterized in that the two-dimensional display 
means Is a display which can randomly access pix- 
els. 

49. A three-dimensional display characterized by com- 
prising: 

a two<limensionarimage generating means for 
generating two-dimensional images in which 
one object of a plurality of objects is selected 
one by one, the plurality of objects having dif- 
ferent depth positions, and the selected object 
is projected on to the planes along the line of 



sight of an observer; and 
a display means for displaying the two-dimen- 
sional images generated by the two<jimension- 
al image generating means simultaneously on 

5 a plurality of image planes at predetermined 
brightness levels for one selected object after 
another, the image planes being located at dif- 
ferent depth positions as seen from the observ- 
er, the display means being adapted to repeti- 

10 tively display all of the two-dimensional images 

generated by the two-dimensional image gen* 
erating means successively within an after im- 
age time of human eye; 
wherein the display means includes: 

« a plurality of two-dimensional display means lo- 

cated at each image plane to display predeter- 
mined two-dimensional images of a plurality of 
two-dimensional images generated by the two- 
dimensional image generating means; and 

2Q a brightness level adjusting means disposed in 

front of the plurality of two-dimensional display 
means, 

50. A three-dimensional display as claimed in claim 49, 

6 characterized in that the brightness level adjusting 
means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the brightness level adjusting means, 
the two-dimensional image generating means se- 

30 lects an object from the plurality of objects to be ob- 
jected at desired brightness level, and generates 
the two<limenstonal images for the selected object, 

51. A three-dimensional display as claimed in claim 49, 
55 characterized in that the two-dimensional image 

generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images of the 
selected object, and the brightness level adjusting 
to means changes the brightness levels in synchro- 
nism with the two-dimensional images being gen- 
erated by the two-dimensional image generating 
means. 

4$ 52. Athree-dimensfcnal display as claimed in claim 51 » 
characterized in that the two-dimensional display 
means are a plu rality of projectors, and the display 
means further includes screens provided one for 
each image plane oh which the two-dimensional fm- 

50 ages are projected from the plurality of projectors. 

53. A three-dimensional display as claimed in claim 51 , 
characterized in that the brightness level adjusting 
means is a beam attenuating filter. 

55 

54, A three-dimensional display as claimed in claim 53, 
characterized in that the beam attenuating filter is 
either a rotary filter which continuously changes 
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I Ight intensity attenuation , a filter that rotates a plu- 
rality Of elite, a filter thai changes an interruption/ 
transmission time by a shutter, or a filterthat chang- 
es a number of times of interruptions/transmissions 
by a shutter. 

55. A three-dimensional display as claimed in claim 51 , 
characterized in that the two-dimensional display 
means are displays which can randomly access pix- 
els. 

56. A three-dimensional display characterized by com- 
prising: 

a two-dimensional image generating means for 
generating two-dimensional images in which 
one object of a plurality of objects is selected 
one by one, the plurality of objects having dlf^ 
ferenl depth positions, the selected object is 
projected on to along the line of sight of an ob- 
server; and 

a display means for displaying tine two-dimen- 
sional Images generated by thetwo-dimensio^ 
al image generating means simultaneously on 
a plurality of Image planes at predetermined 
brightness levels for one selected object after 
another the image planes being located at dif- 
ferent depth positions as seen from the observ- 
er, the display means being adapted to repeti- 
tively display all of the two-dimensional images 
generated by the two-dimensional Image gen- 
erating means successively within an after im- 
age time of human eye; 
wherein the display means Includes: 
a two-dimensional display means located at 
each image plane to display two-dimensional 
images generated by the two-dimensional im- 
age generating means at the predetermined 
brightness levels. 

57. A three-dimensional display as claimed in claim 56, 
characterized In that the two-dimensional display 
means changes the brightness level periodically 
and, In synchronism with the brightness level being 
changed by the two-dimensional display means, 
the two-dimensional image generating means se- 
lects an object from the plurality of objects which 
has two-dimensional images to be displayed at de- 
sired brightness levels, and generates the two-di- 
mensional images of the selected object. 

58. A three-dimensional display as claimed in claim 66, 
characterized in that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional images of the 
selected object, and the two-dimensional display 
means changes the brightness levelin synchronism 



with the two-dimensional images being generated 
by the two-dimensional image generating means. 

59. Athree-dlmensional display as claimed in claim 56, 
5 characterized in that the two-dimensional display 

means is a display which can randomly access pix- 
els. 

60. A three-dimensional display characterized by com- 
1Q prising: 

atwo-dimensEonal image generating means for 
generating two-dimensional images in which 
one object after of a plurality of objects is se- 
ts le.cted one by one, the plurality of objects hav- 
ing different depth positions, and selected ob- 
ject is projected on to the planes along the line 
of sight of an observer; and 
a display means for displaying ihe two-dimen- 
^0 sional images generated by t he two-dimension- 
al image generating means simultaneously on 
a plurality of image planes at predetermined 
brightness levels for one selected object after 
another, the image planes being located at dtf- 
ss ferem depth positions as seen from the observ- 
er, the display means being adapted to repeti- 
tively display alt of the t wo-dim ensiona! images 
generated by the twb-dirnansiona! image gen- 
erating means successively within an after im- 
50 age time of human eye; 

wherein the display means includes: 
a plurality of two-dimensional display means lo- 
cated at each image plane to display at prede- 
termined brightness levels predetermined two* 
55 dimensional Images of a plurality of two-dimen- 

sional images generated by the two-dimension- 
al image generating means. 

61. A three-dimensional display according to claim 6Q, 
40 ..characterized in that the two-dimensional display 

means changes the brightness level periodically 
and, in synchronism with the brightness level being 
changed by the two-dimensional display means, 
the two-dimensional image generating means se- 
45 lects an object from the plurality of objects which 
has two-dimensional imagesto be displayed at de- 
sired brightness levels, and generates the two-di- 
mensional images of the selected object, 

50 62, A three-dimensional display according to claim 60, 
characterized In that the two-dimensional image 
generating means selects one object after another 
from the plurality of objects in a predetermined or- 
der and generates two-dimensional Images for the 

ss selected object and the two-dimensional display 
means changes the brightness levels in synchro- 
nism with the two-dimensional images being gen- 
erated by the two-dimensional image generating 
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means. 

$3. A three-dimensional display according to claim 60, 
characterized in that the two-dimensional display 
means is a display which can randomly access pix- 
els. 

64. In a three-dimensional representation method 
which generates athree-dimensionai image by dis- 
playing the two-dimensional images on all of a plu- 
rality ot image planes at desired brightness levels, 
an object to be presented of two-dimensionaf j mag- 
es being projected on to the planes, and within an 
after image time of human eye, the plurality of Im* 
age planes being located at different depth posi- 
tions, the three-dimensional representation method 
characterized by comprising the steps of: 

controlling a polarization direction of display 
light of the two-dimensional images; and 
passing the display light th rough an optical sys- 
tem that has different focusing positions ac- 
cording to the polarization direction of the pass- 
ing display light so that the display light of the 
two-dimensional images is focused on the plu- 
rality of image planes located at different depth 
positions to display the two-dimensional Imag- 
es on the plurality of image pianes located, at 
different depth positions. 

65. A three-dimensional representation method as 
claimed in claim 64, characterized in that while the 
two-dimensional images are successively 
switched, the polarization direction of the display 
light of the two-dimensional images is successively 
switched to focus the display light of the two-dimen- 
sional images on the plurality of image pianes lo- 
cated at different depth positions to generate a 
three-dimensional moving image. 

66. A three-dimensional representation method as 
claimed in claim 64, characterized in that, in syn- 
chronism with the successive switching of the po- 
larization direction of the display light of the two-di- 
mensional images, the brightness levels of the dis- 
play light of the two-dimensional images are 
changed to desired brightness levels. 

67. A three-dimensional representation method as 
claimed in claim 66, characterized in that the polar- 
ization direction of the display light of the two-di- 
mensional images is controlled to adjust to desired 
levels the brightness levels of the two-dimensional 
images focused on the plurality of image planes lo- 
cated at different depth positions, 

68. A three-dimensional display characterized by com- 
prising: 



a two-dimensional image display means for dis- 
playing two-dimensional images; 
a polarization varying means for controlling a 
polarization direction of display light of the two- 

5 dimensional images entering from the two-di- 
mensional image display means and then out- 
putting the display light; and 

a polarization type bifocal optical system for 
splitting the display light exiting from the polar- 
io ization varying means into two independent po- 

larization directions and focusing the two inde* 
pendent polarization direction beams on two 
different image pianes; 

wherein the two-dimensional image display 
18 means, the polarization varying means and the 

polarization type bifocal optical system are ar- 
ranged so that the two-dimensional images fo- 
cused on the two different image planes over- 
lap each other on the line of sight of an observer 
BP and have different depth positions. 

69. Athree-dimensionai display as claimed in claim 6S 3 
characterized in that the two-dimensional image 
display means changes brightness levels of the 

6 two-dimensional images in synchronism with the 
changing of the polarization direction by the polari- 
zation varying means. 

70. A three-dimensional display as claimed in claim 68, 
3Q characterized in that thepoiarization varying means 

changes the display light of the two-dimensional im- 
ages entering from the two-dimensional image dis- 
play means Into eliiptically polarized light. 

3$ 71. Athree-dimensionai display as claimed in claim 68, 
characterized in thatthe polarization varying means 
changes the display light of the two-dimensional im- 
ages entering from the two-dimensional image dis- 
play means into linearly polarized light having the 

40 two independent polarization directions split by the 
polarization type bifocal optical system or an inter- 
mediate polarization angle between the two inde- 
pendent polarization directions. 

45 72, a three-dimensional display as claimed inolaim 68, 
characterized in thatthe polarization varying means 
includes a medium whose birefringence is changed 
by application of electric field or voltage. 

so 73. A th ree-dimens ional display as claimed in claim 68, 
characterized in that the medium whose birefrin- 
gence is changed, is a liquid crystal. 

74. Athree-dimensionai display as claimed in claim 68, 
ss characterized in that the two-dimensional image 
display means has a plurality of pixels, the polari- 
zation varying means has a plurality of polarization 
varying elements, and each of the polarization var- 
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ying elements of the polarization varying means 
controls polarization of display light of one or more 
pixels of the two-dimensional image display means. 

75. A three-dimensional display as claimed in claim 68, 
characterized in that the polarization type bifocal 
optical system includes a fixed focus lens of anlso^ 
tropic medium and a birefringent medium. 

7S. A three-dimensional display as claimed in claim 68, 
characterized in that the polarization type bifocal 
optical system includes a lens-shaped birefringent 
medium. 

77. A three-dimensional display as claimed in claim 75, 
characterized in that the birefringent medium is a 
liquid crystal, 

7a A th ree-dimensionai display as ciaimed in claim 63, 
characterized in that the polarization type bifocal 
optical system includes: 

a first polarizing beam splitter for splitting the 
display light output from the polarization vary- 
ing means into two independent polarization di- 
rections; 

two optical systems passing the two split dis- 
play beams separated by the first polarizing 
beam splitter and having different image focus- 
ing positions; and 

a second polarizing beam splitter for synthesiz- 
ing the two split display beams that have 
passed through the two optical systems, 

79. A th ree-dimensionai display as claimed in claim 78, 
characterized in that the first or second polarizing 
beam splitter is replaced with two polarizing plates 
having polarization directions different from that of 
the beam splitter. 

30. A three-dimensional representation method which 
generates a three-dimensional image by arranging 
a plurality of image planes at different depth posi- 
tions for each of left and right eyes of an observer 
and by displaying two-dimensional images on the 
plurality of image planesfor each of the left and right 
eyes of the observer, the three-dimensional repre- 
sentation method characterized by comprising the 
steps of: 

generating two-dimensional images In which 
an object to be presented is projected from a 
point on a line passing. trough the left and right 
eyes of the observer onto the plurality of image 
planes; 

changing brightness levels of the generated 
two-dimensional images individually for each 
image plane for the left eye and for the right eye 



of the observer; and 

displaying the generated two-dimensional in> 
ages on the plurality of image planes for the left 
eye and for right eye of the observer. 

5 

81. A three-dimensional representation method as 
claimed in claim 80, 

characterized in that, when the object to be 
presented is displayed at a depth position close to 

10 the observer, the brightness levels of the two-di- 
mensional images displayed on those image planes 
of the plurality of Image pianes which are close to 
the observer are raised and the brightness levelsof 
the two-dimensional images displayed on the im- 

1? age planes remote from the observer are lowered, 
and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the brightness levels of the two- 

20 dimensional images displayed on those image 
planes of the plurality of image planes Which are 
close to the observer are lowered and the bright- 
ness levels of the two-dimensional images dis- 
played on the Image pianes remote from the ob- 

25 server are raised. 

82. A three-dimensional representation method as 
claimed in claim Bi, characterized in that the two- 
dimensional images are displayed on the plurality 

so of image planes so that they overlap each other 
when seen from one point on a line passing through 
the left and right eyes of the observer, and the 
brightness levels of the two-dimensional images 
displayed on the plurality of Image planse are 
35 changed so that an overall brightness level as seen 
by the observer is equal to the brightness level of 
the original object to be presented. 

83. A three-dimensional representation method as 
40 claimed in claim 80, characterized in that the two- 
dimensional images are displayed on the plurality 
of image planes so that they overlap each other 
when seen from one point on a line passing through 
the left and right eyes of the observer, and the 

45 brightness levels of each part of the two-dimension^ 
al images displayed on the plurality of image planes 
are changed according to the depth position of the 
original object to be presented so that an overall 
brightness level as seen by the observer is equal to 

so the brightness level of the object to be presented. 

84. A three-dimensional representation method as 
claimed in claim 80, characterized in that the two- 
dimensional images are successively switched to 

$5 generate a three-dimensional moving image, 

85. A three-dimensional representation method as 
claimed in claim 84, 
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characterized in that when the two-dimen- 
sional images include apluralityof images of an ob- 
ject moving in a direction of depth and the object is 
moving toward the observer, the brightness levels 
of the object images displayed on the plurality of im- 
age planes are progressively raised from an image 
plane remote from the observer toward an image 
plane close to the observer in synchronism with the 
successive switching of the two-dimensional imag- 
es, and 

characterized in that when the two-dimen- 
sional images include a plurality of images of an ob- 
ject moving in a direction of depth and the object is 
moving away from the observer, the brightness lev- 
els of ihe object images displayed on ihe plurality 
of image planes are progressively raised from an 
image plane close to the observer toward an Image 
plane remote from the observer in synchronism with 
the successive switching of the two-dimensional im- 
ages, 

86, A head-mounted display for displaying a three-di- 
mensional Image by displaying two-dimensional im- 
ages on a plurality of image planes located at dif- 
ferent depth positions as seen by an observer, the 
head-mounted display characterized by compris- 
ing: 

a first means for fixing relative positions be- 
tween the plurality of image planes and left and 
right eyes of the observer; 
a second means for generating two-dimension- 
al images In which an object to be presented 
from one point on a line passing through. the left 
and right eyes of the observer onto the plurality 
of image planes; 

a third moans for displaying the two-dimension- 
al images generated by the image generating 
means on at least two of the plurality of image 
planes; and 

a fourth means for changing brightness levels 
of the two-dimensional images displayed on the 
at least two image planes individually for each 
image plane.. 

87. A head-mounted display as claimed in claim 66, 
characterized in that the third means comprises: 

a plurality of two-dimensional displays; 
a total reflecting mirror or partial reflecting mir- 
ror combined with one of the plurality of two- 
dimensional displays which is located at trie re- 
motest depth position from the observer, the to- 
tal reflecting mirror or partial reflecting mirror 
being adapted to locate an image of the one 
two-dimensional display on the line of sight of 
the observer; and 

partial reflecting mirrors combined with the two- 



dimensional displays except for Ihe one two-di- 
mensional display located at the remotest 
depth position from the observer, the partial re- 
flecting mirrors being adapted to locate images 
s of the two-dimensional displays on the line of 

sight of the observers, 

88, A head-mounted display as claimed in claim 86, 
characterized in that the third means comprises: 

10 

a plurality of two-dimenslonaE displays; 
a combination of a total reflecting mirror and a 
lens or a combination of a partial , reflecting mir- 
ror, anda lens, the combination being combined 
1$ with one of the plurality of two-dimensional dis- 

plays which is located at the remotest depth po- 
sition from tfre observer, the combination being 
adapted to locate an image of the one two-di- 
mensional display on the line of sight of the ob- 
20 server; and 

combinations of partial reflecting mirrors and 
lenses, the combinations being combined with 
the two-dimsnsjonal displays exceptforthe one 
two-dimensional display located at the remot- 
es est depth position from the observer, the com- 
bi nations being adapted to locate images of the 
two-dimensional displays on the line of sight of 
the observer, 

3Q ss, a head-mounted display as claimed in claim 86, 
characterized in that ihe third means comprises: 

a plurality of scatter plates capable of control- 
ling a switching between a transmitting state 
35 and a scattering state, the scatter plates being 

located at different depth positions as viewed 
from the observer; 

a plurality of projection type two-dimensional 
displays for projecting two-dimensional images 

40 onto the plurality of scatter plates; and 

apluralityof shutters disposed between the plu- 
rality of scatter piates and the plurality of pro- 
jection type two-dimensional displays, the p!u- 
. raiity of shutters being adapted to switch .be- 

45 tween a transmitting state and a cutoff state In 

synchronism with the switching between the 
transmitting state and the scatterin g state of the 
plurality ol scatter plates. 

■SO 90. A head-mounted display as claimed in claim B6 S 
characterized in that a lens optical system is dis- 
posed between th © plurality of image planes and the 
observer. 

55 91 . A head-mounted display as claimed in claim 88, 
characterized in that, when the object to be 
presented is displayed at a depth position close to 
the observer, the fourth means raises the blight- 
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ness levels of the two-dimensional images dis- 
played on those image planes of the plurality of im- 
age planes which are gloss to the observer and low- 
ers the brightness levels of the two-dimensional im- 
ages displayed on the image planes remote from 
the observer, and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the fourth means lowers the 
brightness levels of the two-dimensional images 
displayed on those image planes of the plurality of 
image planes which are close to the observe r and 
raises the brightness levels of the two-dimensional 
images displayed on the Image planes remotefrom 
the observer 

92. A head-mounted display as claimed in claim 86, 
characterized in that the third means displays the 
two-dimensional images on the plurality of image 
planes so that they overlap each other when viewed 
from one point on a line passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of the two-dimen- 
sional images displayed on the plurality of image 
planes so that an overall brightness level as seen 
by the observer is equal to the brightness level of 
the original object to be presented. 

93. A head-mounted display as claimed in claim 86, 
characterized in that the third means displays the 
two-dimensional images on the plurality ot image 
planes so that they overlap each other when viewed 
from one point on a Ijne passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of each part of the 
two-dimensional Images displayed on the plurality 
of image planes according to the depth position of 
the original object to be presented so that an overall 
brightness level as seen by the observer is equal to 
the brightness level of the object to be presented. 

84. A head-mounted display as claimed in claim 86, 
characterked in that the third means successively 
switches and displays the two-dimensional images 
generated by the image generating means to dis- 
play a three-dimensional moving image. 

95, A head-mounted display as claimed in claim 94, 
characterized in that when the two-dimen- 
sional images generated by the first means include 
a plurality of images of an object moving in a direc- 
tion of depth and the object is moving toward the 
observer, the fourth means progressively raises the 
brightness levels of the object images displayed on 
the. plurality of image planes from an image plane 
remote from the observer toward an image plane 
close to the observer in synchronism with the suc- 
cessiveswitching of the two-dimensional images by 



the third means, and 

characterized in that when the object is mov- 
ing away from the observer, the fourth means pro- 
gressively raises the brightness levels of the object 

5 images displayed on the plurality of image planes 
from an image plane close to the observer toward 
an image plane remote from the observer in syn- 
chronism with the successive switching of the two- 
dimensional images by the third means. 

10 

96, A head-mounted display for displaying a three-di- 
mensional image by displaying two-dimensional im- 
ages on a plurality of image pianes located at dif- 
ferent depth positions as seen from a left eye of an 

is obsen/er and on a plurality of image planes located 
at different depth positions as seen from a right eye 
of the observer, the head-mounted display charac^ 
tensed by comprising: 

6 a first means for fixing relative positions be- 
tween the plurality of image planes for the left 
eye and the left eye of the observer and be- 
tween the plurality of Image planes for the right 
eye and the right eye of the observer; 

26 asecondmeansforgeneratingtwo-dimension- 
al images in which an object to be projected 
from one point on a line passing through the left 
and right eyes of the observer onto the plurality 
d image planes forthe left eye and for the right 

so eye; 

a third means for displaying thetwo-dimensipn- 
al images generated by the image generating 
means on at least two of the plurality of image 
planes for the ieft eye and for the right eye; and 

55 a fourth means for changing brightness levels 

of the two-d imensional images displayed on the 
at least two image planes individually at least 
two Image planes at a time for the left eye and 
for the right eye, 

40 

97. A head-mounted display as claimed iri claim 96, 
characterized in that the thind means comprises: 

a plurality of two-dimensional displays; 

& a total reflecting mirror or partial reflecting mir- 

ror combined With one of the plurality of two- 
dimensional displays which is located at the re- 
motest depth position from the observer, the to- 
tal reflecting mirror or partial reflecting mirror 

50 being adapted to locate an image of the one 

two-dimensional display oh the line of sight of 
the observer; and 

partial reflecting.mirrprs combined with the two- 
dimensional displays except for the one two-di- 
ss mensional display located at the remotest 

depth position from the observer, the partial re- 
flecting mirrors being adapted to locate images 
of the two-dimensional displays on the line of 
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sight of the observers. 

98, A head-mounted display as claimed fa claim 96, 
characterized in that the third means comprises: 

5 

a plurality of two-dimensional displays" 
a combination of a total reflecting mirror and a 
lens or a combination of a partial reflecting mir- 
ror and a lens, the combination being combined 
with one oi the plurality of two-dimensional dis- io 
plays which is located at the remotest depth po- 
sition from the observer, the combination being 
adapted to locate an image of the one two-di* 
mensionai display on the line of sight of the ob- 
server; and is 
combinations of partial reflecting mirrors and 
lenses, the combinations being combined with 
iheiwo-dimensiona! displays except fortheone 
two-dimensional display located at the remot- 
est depth position from the observer, the com- w 
binaiions being adapted to locate images of the 
two-dimensional displays on the line of sight of 
the observer. 

99, A head-mounted display as claimed in claim 96, 2s 
characterized in that the third means comprises: 

a plurality of scatter plates capable of control- 
ling a switching between a transmitting state 
and a scattering state, the scatter plates being 30 
located at different depth positions as viewed 
f rom the observer; 

a plurality of projection type two-dimensional 
displays for projecting two-dimensional images 
onto the plurality of scatter plates; and & 
aplurality of shutters disposed between the plu- 
rality of scatter plates and the plurality of pro- 
jection type two-dimensional displays, the plu^ 
rality of shutters being adapted to switch be- 
tween a transmitting state and a cutoff state in 40 
synchronism with the switching between the 
transmitting state and the scattering state of the 
plurality of scatter plates. 

100, A head-mounted display as claimed in claim 59, 45 
characterized in that a tens optical system is dis- 
posed between the plurality of image planes and the 
observer. 

101 Ahead-mounted display as claimed in claim 96, so 
characterized in that, when the object to be 
presented is displayed at a depth position close to 
the observer* the fourth means raises the bright- 
ness levels of the two-dimensional images dis- 
played on those image planes of the plurality of im- ss 
age planes which are cbse to the observer and low- 
ers the brightness levels of the two-dimensional im- 
ages displayed on the image planes remote from 



the observer, and 

characterized in that, when the object to be 
presented is displayed at a depth position remote 
from the observer, the fourth means lowers the 
brightness levels of the two-dimensional images 
displayed on those image planes of the plurality of 
image planes which are close to the observer and 
raises the brightness levels of the two-dimensional 
images displayed on the image planes remote from 
the observer. 

102. A head-mounted display as claimed in claim 96, 
characterized In that the third means displays the 
two-dimensional images on the plurality of image 
planes so that they overlap each other when viewed 
from one point on a line passing through the left and 
right eyes of the observer, and the fourth means 
changes the brightness levels of the two-dimen- 
sional images displayed on the plurality of image 
planes so that an overall brightness level as seen 
by the observer is equal to the brightness level of 
the original object to be presented. 

103. A head^mounted display as claimed in claim 96, 
characterized in that the third means displays the 
two-dimensional images on the plurality of image 
planes so that they overlap each other when viewed 
from one point on a line passing through the left and 
right eyes of me observer, and the fourth means 
changes the brightness levels of each part of the 
two-dimensional images displayed on the plurality 
of image planes according to the depth position of 
the original object to be presented so that an overall 
brightness level as seen by the observer is equal to 
the brightness level of the object to be presented. 

1 D4.A head-mounted display as claimed in claim 96, 
characterized in that the third means successively 
switches the two-dimensional images generated by 
the image generating means to display a twoHdi- 
mensional moving image. 

10$. A head-mounted display as claimed in claim 1 04, 
characterized in that when the two<Jimen^ 
sional images generated by the first means include 
a plurality of images of an object moving in a direc- 
tion of depth and the object is moving toward the 
observer, the fourth means progressively raises the 
brightness levels of the object images displayed on 
the plurality of image planes from an image plane 
remote from the observer toward an image plane 
close to the observer in synchronism with the suc- 
cessive switching of thetwo-dlmensionai Images by 
the third means, and 

characterized in that when the object is mov- 
ing away from the observer, the fourth means pro- 
gressively raises the brightness levels of the object 
images displayed on the plurality of image planes 
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from an image plane close to the observer toward 
an image plane remote from the observer in syn- 
chronism with the successive switching of the two- 
dimensional images by the third means. 

106. A three-dimensional display characterized by com- 
prising: 

a three-dimensional display means having a 
plurality of two-dimensional displays located at 
different depth positions, the three-dimensional 
dispiay means being adapted to present a 
three-dimensional image by displaying an cb- 
jectto be presented on image p lanes of the plu- 
rality cf two-dimensional displays and by vari- 
ably setting a brightness level ratio of the plu- 
rality of two-dimensional displays according to 
a depth position of the object tp.be presented; 
and 

a viewing zone distributing means for distribut- 
ing a viewing zone of the threQ-dimensionai dis- 
play means into a plurality of directions. 

107. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means expands the viewing zone by distribut- 
ing the viewing zone, 

108. A three-dimensional display as claimed in claim 
106, characterized in that the viewing . zone distrib- 
uting means increases the number of viewing zones 
by distributing the viewing zone. 

109. A three-dimensional display as claimed in claim 
106, characterized in that the viewing zone distrib- 
uting means has an optical system including either 
a plurality of total reflecting mirrors or a plurality of 
prisms, or a combination of these, and reflects or 
refracts light by the optical system to distribute the 
viewing zone. 

110. A three-dimensional display as claimed in claim 
106, characterized in that the Viewing zone distrib- 
uting means has an optica! system including a plu- 
rality of dicbroic mirrors or dichroic prisms with dif- 
ferent reflection wavelength bands oracombinat ion 
of these, and reflects or refracts light by the optical 
system to distribute the viewing zone. 

111. A three-dimensional display as claimed In claim 
1.06, characterized in that the viewing zone distrib- 
uting means has an optical system including a ho- 
lographic optical element with a plurality of reflec- 
tion angles or diffraction angles, a holographic op- 
tical element with astngle reflection angle or diffrac- 
tion angle, or a combination of these, and the view- 
ing zone distributing means reflects or diffracts tight 
by the optical system to distribute the viewing zone. 



112. A three-dimensional dispiay as claimed in claim 
1.06, characterized in that the viewing zone distrib- 
uting means includes a prism array having an array 
of prisms with different refraction directions, and re- 
is tracts light by the prism array to distribute the view- 
ing zone. 

113. A three-dimensional display as claimed tn claim 
106, characterized in that the viewing zone distrib- 

10 uting means includes a mirror array having arrays 
of mirrors with different reflection directions, and re- 
flects light by the mirror array to distribute the view- 
ing zone. 

is 114.A three-dimensional display as claimed in claim 

106, characterized In that the viewing zone distrib- 
uting means includes a diffraction grating array hav- 
ing arrays of diffraction gratings with different dif- 
fraction angles, and reflects or diffracts light by the 

» diffraction grating array to distribute the viewing 
zone. 

1T5.A three-dimensional dispiay according to claim 1 06, 
characterized in that the viewing zone distributing 
35 means includes a liquid crystal deflection element 
having a liquid and an optical element disposed in 
contact with the liquid crystal, and refracts or re- 
flects light by the liquid crystal deflection element to 
distribute the viewing Zone on a time division basis. 

30 

116.A three-dimensional display as claimed in claim 

107, characterized in that the viewing zone distrib- 
uting means includes a movable optical system and 
a shutter device for performing shutter operations, 

os the movable optical system being either half mir- 
rors, total reflecting mirrors or prisms, or a combi- 
nation of these, and characterized in that the view- 
ing zone distributing means distributes the viewing 
zone on a time division basis by arranging the shut- 

40 ter device between the three-dimensional display 
and the optical system, reflecting or refracting light 
by the optical system and synchronizing the three- 
dlmen signal display with the shutter device. 

is 117.A three-dimensional display as cialmed in claim 
106, characterized in that the viewing zone distrib- 
uting means includes a movable optical system, 
which is either half mirrors, total reflection mirrors 
or prisms, or a combination of these, and the view^ 

$o ing zone distributing means operates the optical 
system stepwise to reflect or refract light and there- 
by distribute the viewing zone on a time division ba- 
sis. 
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